-- Logs begin at Tue 2022-07-26 13:52:02 UTC, end at Tue 2022-07-26 15:02:47 UTC. -- Jul 26 14:36:35.156796 dv-cinder-851030-1-smb systemd[1]: Starting Devstack devstack@keystone.service... Jul 26 14:36:35.168971 dv-cinder-851030-1-smb devstack@keystone.service[87044]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jul 26 14:36:35.172150 dv-cinder-851030-1-smb devstack@keystone.service[87044]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Jul 26 14:36:35 2022] *** Jul 26 14:36:35.172150 dv-cinder-851030-1-smb devstack@keystone.service[87044]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 26 14:36:35.172150 dv-cinder-851030-1-smb devstack@keystone.service[87044]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 26 14:36:35.172150 dv-cinder-851030-1-smb devstack@keystone.service[87044]: nodename: dv-cinder-851030-1-smb Jul 26 14:36:35.172150 dv-cinder-851030-1-smb devstack@keystone.service[87044]: machine: x86_64 Jul 26 14:36:35.172150 dv-cinder-851030-1-smb devstack@keystone.service[87044]: clock source: unix Jul 26 14:36:35.172150 dv-cinder-851030-1-smb devstack@keystone.service[87044]: pcre jit disabled Jul 26 14:36:35.172150 dv-cinder-851030-1-smb devstack@keystone.service[87044]: detected number of CPU cores: 4 Jul 26 14:36:35.172150 dv-cinder-851030-1-smb devstack@keystone.service[87044]: current working directory: / Jul 26 14:36:35.172150 dv-cinder-851030-1-smb devstack@keystone.service[87044]: detected binary path: /usr/bin/uwsgi-core Jul 26 14:36:35.172150 dv-cinder-851030-1-smb devstack@keystone.service[87044]: your processes number limit is 47680 Jul 26 14:36:35.172150 dv-cinder-851030-1-smb devstack@keystone.service[87044]: your memory page size is 4096 bytes Jul 26 14:36:35.172150 dv-cinder-851030-1-smb devstack@keystone.service[87044]: detected max file descriptor number: 2048 Jul 26 14:36:35.172150 dv-cinder-851030-1-smb devstack@keystone.service[87044]: lock engine: pthread robust mutexes Jul 26 14:36:35.173437 dv-cinder-851030-1-smb devstack@keystone.service[87044]: thunder lock: enabled Jul 26 14:36:35.173437 dv-cinder-851030-1-smb devstack@keystone.service[87044]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jul 26 14:36:35.173437 dv-cinder-851030-1-smb devstack@keystone.service[87044]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 26 14:36:35.244432 dv-cinder-851030-1-smb devstack@keystone.service[87044]: Python main interpreter initialized at 0x555c287249c0 Jul 26 14:36:35.244432 dv-cinder-851030-1-smb devstack@keystone.service[87044]: python threads support enabled Jul 26 14:36:35.244432 dv-cinder-851030-1-smb devstack@keystone.service[87044]: your server socket listen backlog is limited to 100 connections Jul 26 14:36:35.244432 dv-cinder-851030-1-smb devstack@keystone.service[87044]: your mercy for graceful operations on workers is 90 seconds Jul 26 14:36:35.245079 dv-cinder-851030-1-smb devstack@keystone.service[87044]: mapped 403077 bytes (393 KB) for 2 cores Jul 26 14:36:35.245156 dv-cinder-851030-1-smb devstack@keystone.service[87044]: *** Operational MODE: preforking *** Jul 26 14:36:35.245653 dv-cinder-851030-1-smb devstack@keystone.service[87044]: *** uWSGI is running in multiple interpreter mode *** Jul 26 14:36:35.245653 dv-cinder-851030-1-smb devstack@keystone.service[87044]: spawned uWSGI master process (pid: 87044) Jul 26 14:36:35.246088 dv-cinder-851030-1-smb systemd[1]: Started Devstack devstack@keystone.service. Jul 26 14:36:35.248672 dv-cinder-851030-1-smb devstack@keystone.service[87044]: spawned uWSGI worker 1 (pid: 87055, cores: 1) Jul 26 14:36:35.248672 dv-cinder-851030-1-smb devstack@keystone.service[87044]: spawned uWSGI worker 2 (pid: 87056, cores: 1) Jul 26 14:36:35.248672 dv-cinder-851030-1-smb devstack@keystone.service[87044]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 26 14:36:41.286987 dv-cinder-851030-1-smb devstack@keystone.service[87055]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 26 14:36:41.286987 dv-cinder-851030-1-smb devstack@keystone.service[87055]: from cryptography.utils import int_from_bytes Jul 26 14:36:41.287868 dv-cinder-851030-1-smb devstack@keystone.service[87055]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 26 14:36:41.287868 dv-cinder-851030-1-smb devstack@keystone.service[87055]: from cryptography.utils import int_from_bytes Jul 26 14:36:41.347458 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 26 14:36:41.347668 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 26 14:36:41.347832 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] command line args: [] {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 26 14:36:41.348097 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 26 14:36:41.348271 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] ================================================================================ {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 26 14:36:41.348527 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] admin_token = **** {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:36:41.348770 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] config_dir = [] {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:36:41.348956 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:36:41.349135 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] config_source = [] {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:36:41.349314 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] debug = True {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:36:41.349511 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:36:41.350849 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:36:41.350849 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] insecure_debug = False {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:36:41.350849 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:36:41.350849 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:36:41.350849 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] list_limit = None {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:36:41.351177 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] log_config_append = None {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:36:41.351177 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:36:41.351288 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] log_dir = None {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:36:41.351465 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] log_file = None {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:36:41.351635 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:36:41.352222 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:36:41.352222 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:36:41.352374 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:36:41.352530 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:36:41.352708 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:36:41.352950 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:36:41.353195 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:36:41.353425 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:36:41.353655 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:36:41.353883 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:36:41.354109 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:36:41.354386 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:36:41.354739 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] notification_format = cadf {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:36:41.355015 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:36:41.355541 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.93/identity {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:36:41.355737 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] publish_errors = False {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:36:41.355929 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:36:41.356157 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:36:41.356332 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:36:41.356564 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:36:41.356794 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:36:41.357029 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] standard_threads = False {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:36:41.357322 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] strict_password_check = False {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:36:41.357484 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:36:41.357658 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] use_eventlog = False {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:36:41.357832 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] use_journal = False {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:36:41.358004 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] use_json = False {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:36:41.358177 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] use_stderr = False {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:36:41.358375 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] use_syslog = False {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:36:41.358604 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] watch_log_file = False {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:36:41.364879 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.364879 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.364879 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.364879 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.364879 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.364879 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.364879 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.364879 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.364879 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.365550 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.365550 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.365550 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.365550 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.365550 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.365550 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.365550 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.365550 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.365550 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.366159 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.366159 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.366159 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.366159 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.366159 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.366159 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.366159 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.366159 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.366159 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.367152 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.367152 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.367152 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.367152 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.367152 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.367152 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.367152 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.367152 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.367152 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.368171 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.368171 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.368171 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.368171 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.368171 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.368708 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.368708 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.368708 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.369042 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.369176 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.369367 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.369609 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.369841 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.370076 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.370881 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.371131 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.371362 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.371600 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.371928 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.372165 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.372403 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.372638 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.372868 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.373115 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.373349 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.373585 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.373816 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.374077 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.374344 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.374585 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.374820 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.375083 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.375327 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.375566 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.375810 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.376058 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.376292 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.376527 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.376766 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.377008 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] cache.enabled = True {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.377246 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.377479 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.377722 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.377955 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.378188 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.378470 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.378704 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.378936 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.379195 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.379446 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.379678 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.379912 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.380181 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.380383 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.380613 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.380844 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.381079 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.381303 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.381531 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.381766 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.381975 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.382218 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.382475 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.382719 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.382958 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.383219 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.383475 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.383718 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.383947 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] auth.external = None {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.384166 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] auth.mapped = None {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.384465 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.384738 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.384968 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] auth.password = None {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.385191 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] auth.token = None {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.385377 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.385574 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] catalog.caching = True {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.385774 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.386772 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.387111 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.387512 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.387698 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.387891 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] credential.caching = True {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.388094 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] credential.driver = sql {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.388313 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.388515 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.388733 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.388936 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.389156 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.389435 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.389686 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.389926 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.390162 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.390483 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.390729 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.390995 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.391236 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.391492 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.391726 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] federation.caching = True {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.391963 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.392345 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] federation.driver = sql {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.392541 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.392739 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.392962 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.393175 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.393373 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.393596 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.393852 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.394091 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.394374 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.394603 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] identity.caching = True {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.394843 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.395090 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.395331 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.395571 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.395793 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] identity.driver = sql {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.396032 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.396269 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.396522 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.396772 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.397016 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.397234 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.397443 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.398065 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.398065 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.398539 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.398539 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.398965 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.398965 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.399369 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.399369 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.399759 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.399759 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.400168 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.400389 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.400592 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.400799 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.401010 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.401216 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.401440 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.401642 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.401859 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.402058 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.402337 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.402546 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.402862 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.403161 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] ldap.password = **** {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.403336 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.403505 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.403761 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.403927 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.404144 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.404395 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.404644 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.404873 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.405102 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.405350 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.405654 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.405845 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.406056 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.406318 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.406552 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] ldap.user = None {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.406794 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.409822 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.409822 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.409822 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.409822 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.409822 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.409822 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.409822 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.409822 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.409822 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.411017 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.411017 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.411017 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.411017 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.411017 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.411017 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.411017 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.411770 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.411770 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.411770 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.412127 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.412256 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.412381 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.412625 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.412874 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.413109 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.413364 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] policy.driver = sql {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.413591 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.413835 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.414075 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.414335 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] receipt.caching = True {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.414574 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.414821 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.415063 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.415292 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.415527 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.415766 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] resource.caching = True {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.416014 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.416261 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] resource.driver = sql {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.416497 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.416746 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.417110 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.417628 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] revoke.caching = True {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.417877 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.418118 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.418384 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] role.cache_time = None {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.418622 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] role.caching = True {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.418872 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] role.driver = sql {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.419107 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] role.list_limit = None {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.419355 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.419600 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.419850 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.420096 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.420343 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.420587 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.420831 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.421079 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.421313 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.421560 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.421808 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.422055 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.422328 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.422781 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.423015 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.423263 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.423514 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.423759 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.424011 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.424240 dv-cinder-851030-1-smb devstack@keystone.service[87056]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 26 14:36:41.424240 dv-cinder-851030-1-smb devstack@keystone.service[87056]: from cryptography.utils import int_from_bytes Jul 26 14:36:41.425087 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.425087 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.425087 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.425498 dv-cinder-851030-1-smb devstack@keystone.service[87056]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 26 14:36:41.425498 dv-cinder-851030-1-smb devstack@keystone.service[87056]: from cryptography.utils import int_from_bytes Jul 26 14:36:41.425732 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.425732 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.425732 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.425732 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.426355 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.426355 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.426558 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.426708 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.426836 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.427064 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] token.cache_time = None {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.427299 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] token.caching = True {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.427534 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.427781 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] token.provider = fernet {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.428021 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.428277 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.428524 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.428761 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.429000 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.429242 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.429487 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] trust.driver = sql {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.429778 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.429954 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.430188 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.430463 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.430712 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.430972 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.431168 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.431464 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.431724 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] database.connection = **** {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.431967 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.432215 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.432449 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.433334 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.433487 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.433682 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.433921 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.434152 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.434421 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.434654 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.434895 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.435127 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.435376 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.435609 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.435852 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.436081 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.436319 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.436551 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.436717 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=87055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 26 14:36:41.469096 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=87055) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 14:36:41.469379 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=87055) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 14:36:41.469538 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=87055) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 14:36:41.478664 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=87055) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 14:36:41.485166 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 26 14:36:41.485416 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 26 14:36:41.485566 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] command line args: [] {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 26 14:36:41.485798 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 26 14:36:41.485977 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] ================================================================================ {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 26 14:36:41.486273 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] admin_token = **** {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:36:41.486528 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] config_dir = [] {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:36:41.486717 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:36:41.486904 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] config_source = [] {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:36:41.487088 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] debug = True {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:36:41.487311 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:36:41.487556 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:36:41.487786 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] insecure_debug = False {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:36:41.488058 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:36:41.488313 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:36:41.488548 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] list_limit = None {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:36:41.488729 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] log_config_append = None {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:36:41.488909 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:36:41.489087 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] log_dir = None {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:36:41.489303 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] log_file = None {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:36:41.489545 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:36:41.489863 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:36:41.490048 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:36:41.490344 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:36:41.490524 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:36:41.490704 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:36:41.490957 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:36:41.491206 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:36:41.491441 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:36:41.491677 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:36:41.491914 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:36:41.492145 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:36:41.492396 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:36:41.492645 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] notification_format = cadf {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:36:41.492926 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:36:41.493452 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.93/identity {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:36:41.493620 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] publish_errors = False {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:36:41.493858 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:36:41.494093 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:36:41.494294 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:36:41.494548 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:36:41.494854 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:36:41.495097 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] standard_threads = False {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:36:41.496100 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] strict_password_check = False {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:36:41.496236 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:36:41.496396 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] use_eventlog = False {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:36:41.496597 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] use_journal = False {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:36:41.496833 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] use_json = False {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:36:41.496955 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] use_stderr = False {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:36:41.497088 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] use_syslog = False {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:36:41.497327 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] watch_log_file = False {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:36:41.497591 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.497832 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.498090 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.498359 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.498616 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.498860 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.499113 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.499351 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.499602 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.499852 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.500110 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.500346 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.500597 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.500832 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.501085 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.501334 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.501574 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.501831 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.502088 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.502362 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.502638 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.502899 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.503166 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.503420 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.503667 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.503903 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.504136 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.504369 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.504606 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.504859 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.505114 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.505347 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.505580 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.505828 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.506078 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.506343 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.506609 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.506837 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.507082 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.507370 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.507603 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.507835 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.508068 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.508302 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.508540 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.508792 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.509027 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.509266 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.509497 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.509740 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.509976 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.510231 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.510484 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.510728 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.511543 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.512043 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.512043 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.512402 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.512564 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.512757 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.512999 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.513241 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.513478 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.513761 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.514002 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.514276 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.514503 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.514742 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.515024 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.515263 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.515517 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.515770 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.516011 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.516245 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.516483 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.516737 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] cache.enabled = True {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.516977 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.517271 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.517458 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.517762 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.518010 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.518313 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.518512 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.518749 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.519020 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.521556 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.521556 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.521556 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.521973 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=87055) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 14:36:41.522095 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.522220 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=87055) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 14:36:41.522427 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.522427 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.522427 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.522427 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.522427 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.522427 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.522427 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.522427 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.522427 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.523346 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.523346 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.523346 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.523346 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.523346 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.523877 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.523877 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] auth.external = None {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.524088 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] auth.mapped = None {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.524200 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.524439 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.524674 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] auth.password = None {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.524912 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] auth.token = None {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.525154 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.525393 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] catalog.caching = True {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.525734 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.525868 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.526115 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.526393 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.526675 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.526915 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] credential.caching = True {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.527169 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] credential.driver = sql {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.527421 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.527674 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.527915 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.528162 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.528401 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.528671 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.528930 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.529351 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.529503 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.529796 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.530050 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.530348 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.530599 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.530861 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.531100 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] federation.caching = True {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.531344 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.531595 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] federation.driver = sql {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.531848 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.532348 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.532601 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.532885 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.533106 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.533411 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.533660 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.533904 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.534155 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.534418 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] identity.caching = True {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.534672 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.534931 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.535172 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.535413 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.535665 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] identity.driver = sql {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.535900 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.536141 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.536394 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.536652 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.536890 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.537175 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.537361 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.537626 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.537862 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.538112 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.538395 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.538650 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.538927 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.539171 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.539413 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.539648 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.539891 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.540124 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.540363 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.540673 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.540999 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.541263 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.541502 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.541756 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.542012 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.542700 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.543353 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.543611 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.543852 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.544098 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.544336 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] ldap.password = **** {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.544602 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.544847 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.545102 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.545345 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.545593 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.545849 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.546106 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.546372 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.546611 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.546865 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.547263 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.547533 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.547644 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.547843 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.548080 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] ldap.user = None {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.548340 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.548607 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.548845 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.549096 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.549348 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.549598 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.549839 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.550073 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.550341 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.550583 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.550825 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.551060 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.551312 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.551563 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.551814 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.552065 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.552382 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.552623 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.552877 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.553119 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.553361 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.553605 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.553890 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.554141 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.554416 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.554660 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.554917 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] policy.driver = sql {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.555154 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.555409 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.555648 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.555915 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] receipt.caching = True {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.556320 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.556576 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.556823 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.557060 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.557300 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.557556 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] resource.caching = True {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.558424 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.558758 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] resource.driver = sql {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.559000 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.559254 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.559508 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.559758 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] revoke.caching = True {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.560046 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.560272 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.560517 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] role.cache_time = None {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.560761 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] role.caching = True {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.561009 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] role.driver = sql {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.561244 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] role.list_limit = None {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.561498 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.561751 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.562002 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.562270 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.562526 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.562788 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.563040 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.563294 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.563530 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.563781 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.564034 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.564285 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.564534 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.564985 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.565231 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.565487 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.565743 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.566002 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.566278 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.566522 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.566787 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.567043 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.567289 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.567662 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.567872 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.568117 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.568376 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.568636 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.568887 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.569127 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.569366 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.569601 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] token.cache_time = None {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.569838 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] token.caching = True {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.570077 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.570361 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] token.provider = fernet {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.570604 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.570863 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.571113 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.571354 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.571601 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.571846 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.572096 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] trust.driver = sql {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.572336 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.572578 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.572816 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.573130 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.573441 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.574185 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.574459 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.574766 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.575034 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] database.connection = **** {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.583928 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.583928 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.583928 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.583928 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.583928 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.583928 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.583928 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.583928 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.583928 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.584921 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.584921 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.584921 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.584921 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.584921 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.584921 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.584921 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.584921 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.584921 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:36:41.585851 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=87056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 26 14:36:41.605602 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=87056) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 14:36:41.605824 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=87056) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 14:36:41.606034 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=87056) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 14:36:41.615127 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=87056) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 14:36:41.625403 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=87055) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 14:36:41.637656 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=87056) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 14:36:41.637881 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=87056) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 14:36:41.692609 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=87056) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 14:36:41.708334 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=87055) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 14:36:41.708564 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=87055) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 14:36:41.731797 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=87056) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 14:36:41.732028 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=87056) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 14:36:41.785248 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87055) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 14:36:41.785473 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=87055) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 14:36:41.785698 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=87055) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 14:36:41.785920 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=87055) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 14:36:41.786137 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=87055) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 14:36:41.786387 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=87055) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 14:36:41.789391 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87056) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 14:36:41.789568 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=87056) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 14:36:41.789791 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=87056) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 14:36:41.790019 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=87056) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 14:36:41.790395 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=87056) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 14:36:41.790749 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=87056) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 14:36:41.826325 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87055) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 14:36:41.826525 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=87055) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 14:36:41.826753 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=87055) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 14:36:41.826975 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=87055) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 14:36:41.827189 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=87055) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 14:36:41.827402 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=87055) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 14:36:41.827619 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=87055) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 14:36:41.827810 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87056) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 14:36:41.828052 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=87056) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 14:36:41.828276 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=87056) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 14:36:41.828493 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=87056) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 14:36:41.828708 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=87056) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 14:36:41.828917 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=87056) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 14:36:41.829123 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=87056) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 14:36:41.840241 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=87055) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 14:36:41.844312 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=87056) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 14:36:41.860847 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87055) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 14:36:41.861062 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=87055) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 14:36:41.861281 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=87055) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 14:36:41.861500 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=87055) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 14:36:41.861582 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87056) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 14:36:41.861729 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=87055) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 14:36:41.861905 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=87056) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 14:36:41.862064 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=87055) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 14:36:41.862206 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=87055) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 14:36:41.862460 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=87056) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 14:36:41.862622 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=87056) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 14:36:41.862981 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=87056) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 14:36:41.863292 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=87056) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 14:36:41.863715 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=87056) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 14:36:41.881024 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=87055) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:36:41.881289 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=87055) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 26 14:36:41.881535 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=87055) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:36:41.881965 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=87055) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 26 14:36:41.882112 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=87055) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:36:41.882391 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=87055) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:36:41.882646 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=87055) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:36:41.882903 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=87055) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:36:41.883072 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=87056) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:36:41.883281 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=87056) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 26 14:36:41.883635 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=87056) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:36:41.883863 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=87056) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 26 14:36:41.884260 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=87056) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:36:41.884519 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=87056) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:36:41.884770 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=87056) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:36:41.885019 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=87056) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:36:41.893632 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=87055) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:36:41.893934 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=87055) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:36:41.894207 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=87055) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:36:41.894523 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=87055) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:36:41.896509 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=87056) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:36:41.896726 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=87056) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:36:41.896998 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=87056) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:36:41.897275 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=87056) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:36:41.902447 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=87055) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 14:36:41.905804 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=87056) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 14:36:41.907846 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=87055) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 14:36:41.908141 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=87055) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:36:41.908421 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=87055) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:36:41.908701 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=87055) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:36:41.908979 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=87055) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:36:41.909234 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=87055) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:36:41.909499 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=87055) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:36:41.909768 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=87055) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:36:41.910037 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=87055) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:36:41.910337 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=87055) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:36:41.910602 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=87055) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:36:41.911185 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=87056) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 14:36:41.911473 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=87056) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:36:41.911751 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=87056) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:36:41.912028 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=87056) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:36:41.912305 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=87056) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:36:41.912563 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=87056) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:36:41.912826 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=87056) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:36:41.913095 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=87056) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:36:41.913362 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=87056) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:36:41.913628 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=87056) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:36:41.913888 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=87056) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:36:41.935030 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=87055) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:36:41.936481 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=87055) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 14:36:41.936762 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=87055) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:36:41.941871 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=87055) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 14:36:41.942178 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=87055) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:36:41.942454 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=87055) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:36:41.950213 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=87055) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 14:36:41.950649 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=87055) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:36:41.952043 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=87056) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:36:41.954200 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=87056) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 14:36:41.954688 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=87056) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:36:41.955610 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=87055) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 14:36:41.956093 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=87055) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:36:41.963443 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=87055) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:36:41.963443 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=87055) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:36:41.963443 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=87055) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:36:41.963443 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=87055) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:36:41.963443 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=87055) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:36:41.963443 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=87055) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:36:41.964790 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=87056) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 14:36:41.964925 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=87056) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:36:41.965400 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=87056) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:36:41.973618 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=87056) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 14:36:41.973900 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=87056) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:36:41.975256 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=87055) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:36:41.975553 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=87055) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:36:41.978572 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=87056) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 14:36:41.978870 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=87056) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:36:41.979155 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=87056) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:36:41.980466 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=87056) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:36:41.980623 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=87055) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 14:36:41.980765 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=87056) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:36:41.981149 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=87056) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:36:41.981416 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=87056) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:36:41.981708 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=87056) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:36:41.983650 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=87055) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:36:41.983955 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=87055) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:36:41.988670 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=87055) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 14:36:41.992084 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=87055) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 14:36:41.996119 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=87055) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:36:41.999459 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=87055) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:36:41.999459 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=87055) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:36:41.999459 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=87055) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:36:41.999459 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=87055) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:36:41.999459 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=87055) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:36:42.000177 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=87056) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:36:42.000539 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=87056) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:36:42.007633 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=87056) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 14:36:42.012445 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=87056) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:36:42.012849 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=87056) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:36:42.014935 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=87055) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 14:36:42.015248 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=87055) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:36:42.015522 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=87055) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:36:42.015784 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=87055) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:36:42.017609 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=87056) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 14:36:42.023198 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=87055) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:36:42.023459 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=87056) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 14:36:42.024877 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=87055) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:36:42.025163 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=87055) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:36:42.028920 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=87055) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 14:36:42.029147 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=87056) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:36:42.029314 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=87055) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:36:42.029429 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=87056) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:36:42.029537 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=87055) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:36:42.029646 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=87056) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:36:42.029755 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=87055) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:36:42.029899 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=87056) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:36:42.030025 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=87055) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:36:42.030268 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=87056) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:36:42.030634 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=87056) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:36:42.042408 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=87055) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 14:36:42.042802 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=87055) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:36:42.043224 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=87055) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:36:42.043511 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=87055) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:36:42.043796 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=87055) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:36:42.044075 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=87055) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:36:42.044364 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=87055) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:36:42.051382 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=87056) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 14:36:42.051672 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=87056) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:36:42.051937 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=87056) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:36:42.052193 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=87056) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:36:42.060844 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=87055) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 14:36:42.061125 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=87056) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:36:42.064001 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=87055) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 14:36:42.064201 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=87056) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:36:42.064436 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=87056) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:36:42.067208 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=87055) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:36:42.068745 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=87056) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 14:36:42.069048 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=87056) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:36:42.069326 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=87056) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:36:42.069611 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=87056) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:36:42.069889 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=87056) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:36:42.070008 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=87055) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:36:42.071602 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=87055) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 14:36:42.072038 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=87055) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:36:42.072329 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=87055) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:36:42.079729 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=87055) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:36:42.081410 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=87055) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 14:36:42.082912 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=87056) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 14:36:42.083282 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=87056) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:36:42.083572 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=87056) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:36:42.083882 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=87056) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:36:42.084159 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=87056) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:36:42.084468 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=87056) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:36:42.084574 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=87055) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:36:42.084773 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=87055) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:36:42.084879 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=87056) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:36:42.085066 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=87055) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:36:42.085345 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=87055) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:36:42.094368 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=87055) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 14:36:42.094634 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=87055) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:36:42.094925 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=87055) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:36:42.102098 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=87055) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 14:36:42.102392 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=87055) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:36:42.102684 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=87055) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:36:42.102961 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=87055) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:36:42.103239 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=87055) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:36:42.103555 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=87055) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:36:42.103826 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=87055) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:36:42.104102 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=87055) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:36:42.104504 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=87055) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:36:42.104896 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=87055) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:36:42.105171 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=87055) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:36:42.105438 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=87055) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:36:42.105907 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=87055) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:36:42.106171 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=87055) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:36:42.107089 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=87056) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 14:36:42.110554 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=87056) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 14:36:42.114052 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=87056) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:36:42.116956 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=87056) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:36:42.118657 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=87056) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 14:36:42.119031 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=87056) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:36:42.119264 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=87056) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:36:42.127909 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=87056) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:36:42.129771 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=87056) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 14:36:42.133297 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=87056) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:36:42.133592 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=87056) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:36:42.133889 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=87056) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:36:42.134190 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=87056) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:36:42.142099 dv-cinder-851030-1-smb devstack@keystone.service[87055]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x555c287249c0 pid: 87055 (default app) Jul 26 14:36:42.145826 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03d5bcf-bfae-45ab-b610-7a0ea37b976f None None] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:36:42.146110 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03d5bcf-bfae-45ab-b610-7a0ea37b976f None None] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:36:42.146427 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03d5bcf-bfae-45ab-b610-7a0ea37b976f None None] PATH_INFO: `/v3` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:36:42.148141 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=87056) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 14:36:42.148419 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=87056) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:36:42.148700 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=87056) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:36:42.151198 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 1/1] 10.222.0.93 () {50 vars in 791 bytes} [Tue Jul 26 14:36:42 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:36:42.156843 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=87056) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 14:36:42.157393 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=87056) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:36:42.157725 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=87056) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:36:42.158000 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=87056) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:36:42.158306 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=87056) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:36:42.158588 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=87056) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:36:42.158858 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=87056) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:36:42.159124 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=87056) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:36:42.160373 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=87056) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:36:42.160373 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=87056) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:36:42.160373 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=87056) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:36:42.160373 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=87056) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:36:42.160791 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=87056) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:36:42.160791 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=87056) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 14:36:42.202414 dv-cinder-851030-1-smb devstack@keystone.service[87056]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x555c287249c0 pid: 87056 (default app) Jul 26 14:36:52.004664 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad490c23-0d8e-4430-ad96-39df463c8443 None None] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:36:52.005190 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad490c23-0d8e-4430-ad96-39df463c8443 None None] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:36:52.005190 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad490c23-0d8e-4430-ad96-39df463c8443 None None] PATH_INFO: `/` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:36:52.006891 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 2/2] 10.222.0.93 () {54 vars in 926 bytes} [Tue Jul 26 14:36:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 14:36:52.018028 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccc020a-a014-4c5b-a6d6-eb939a7da65f None None] REQUEST_METHOD: `POST` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:36:52.018677 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccc020a-a014-4c5b-a6d6-eb939a7da65f None None] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:36:52.018907 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccc020a-a014-4c5b-a6d6-eb939a7da65f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:36:52.171104 dv-cinder-851030-1-smb devstack@keystone.service[87056]: INFO dbcounter [None req-9ccc020a-a014-4c5b-a6d6-eb939a7da65f None None] Registered counter for database keystone Jul 26 14:36:52.195257 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG oslo_db.sqlalchemy.engines [None req-9ccc020a-a014-4c5b-a6d6-eb939a7da65f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87056) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 26 14:36:52.204009 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writer thread running {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 26 14:36:52.402942 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG passlib.handlers.bcrypt [None req-9ccc020a-a014-4c5b-a6d6-eb939a7da65f None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=87056) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 26 14:36:52.403514 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG passlib.handlers.bcrypt [None req-9ccc020a-a014-4c5b-a6d6-eb939a7da65f None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=87056) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 26 14:36:52.461703 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.auth.core [None req-9ccc020a-a014-4c5b-a6d6-eb939a7da65f None None] MFA Rules not processed for user `e5ef88cc058f425b882bcb87a1e1e75c`. Rule list: `[]` (Enabled: `True`). {{(pid=87056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:36:52.463423 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.fernet_utils [None req-9ccc020a-a014-4c5b-a6d6-eb939a7da65f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:36:52.616278 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 1/3] 10.222.0.93 () {58 vars in 1023 bytes} [Tue Jul 26 14:36:52 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 604 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 26 14:36:52.765777 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad490c23-0d8e-4430-ad96-39df463c8443 None None] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:36:52.845537 dv-cinder-851030-1-smb devstack@keystone.service[87055]: INFO dbcounter [None req-ad490c23-0d8e-4430-ad96-39df463c8443 None None] Registered counter for database keystone Jul 26 14:36:52.866942 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG oslo_db.sqlalchemy.engines [None req-ad490c23-0d8e-4430-ad96-39df463c8443 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87055) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 26 14:36:52.875297 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writer thread running {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 26 14:36:53.017441 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad490c23-0d8e-4430-ad96-39df463c8443 None None] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:36:53.022537 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3331ecff-06e1-4ad4-9588-33bed0a78758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f499667f2a194620a3504e461bf3cc25', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:36:53.037437 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3331ecff-06e1-4ad4-9588-33bed0a78758 admin admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:36:53.037437 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3331ecff-06e1-4ad4-9588-33bed0a78758 admin admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:36:53.037437 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3331ecff-06e1-4ad4-9588-33bed0a78758 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:36:53.037437 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3331ecff-06e1-4ad4-9588-33bed0a78758 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:36:53.087232 dv-cinder-851030-1-smb devstack@keystone.service[87055]: WARNING keystone.common.rbac_enforcer.enforcer [None req-3331ecff-06e1-4ad4-9588-33bed0a78758 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 26 14:36:53.087574 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3331ecff-06e1-4ad4-9588-33bed0a78758 admin admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:36:53.098459 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 3/4] 10.222.0.93 () {58 vars in 1324 bytes} [Tue Jul 26 14:36:52 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 26 14:36:53.105556 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccc020a-a014-4c5b-a6d6-eb939a7da65f None None] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:36:53.122229 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccc020a-a014-4c5b-a6d6-eb939a7da65f None None] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:36:53.126831 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974fa3d3-0412-4135-9564-43b62efd28e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f499667f2a194620a3504e461bf3cc25', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:36:53.127995 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974fa3d3-0412-4135-9564-43b62efd28e5 admin admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:36:53.128293 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974fa3d3-0412-4135-9564-43b62efd28e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:36:53.128574 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974fa3d3-0412-4135-9564-43b62efd28e5 admin admin] PATH_INFO: `/v3/projects/f499667f2a194620a3504e461bf3cc25` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:36:53.130168 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974fa3d3-0412-4135-9564-43b62efd28e5 admin admin] RBAC: Authorizing `identity:get_project(project_id=f499667f2a194620a3504e461bf3cc25)` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:36:53.183007 dv-cinder-851030-1-smb devstack@keystone.service[87056]: WARNING keystone.common.rbac_enforcer.enforcer [None req-974fa3d3-0412-4135-9564-43b62efd28e5 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 26 14:36:53.183722 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974fa3d3-0412-4135-9564-43b62efd28e5 admin admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:36:53.188509 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 2/5] 10.222.0.93 () {56 vars in 1207 bytes} [Tue Jul 26 14:36:53 2022] GET /identity/v3/projects/f499667f2a194620a3504e461bf3cc25 => generated 344 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:36:55.275352 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910b2096-3cb8-47cd-b7fa-b0cdeb924c46 None None] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:36:55.275984 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910b2096-3cb8-47cd-b7fa-b0cdeb924c46 None None] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:36:55.276602 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910b2096-3cb8-47cd-b7fa-b0cdeb924c46 None None] PATH_INFO: `/` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:36:55.281666 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 4/6] 10.222.0.93 () {54 vars in 926 bytes} [Tue Jul 26 14:36:55 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 14:36:55.288269 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584122d3-f0d3-44cf-8787-7298e904ec38 None None] REQUEST_METHOD: `POST` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:36:55.288855 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584122d3-f0d3-44cf-8787-7298e904ec38 None None] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:36:55.288855 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584122d3-f0d3-44cf-8787-7298e904ec38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:36:55.312310 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.auth.core [None req-584122d3-f0d3-44cf-8787-7298e904ec38 None None] MFA Rules not processed for user `e5ef88cc058f425b882bcb87a1e1e75c`. Rule list: `[]` (Enabled: `True`). {{(pid=87056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:36:55.313865 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.fernet_utils [None req-584122d3-f0d3-44cf-8787-7298e904ec38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:36:55.322091 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 3/7] 10.222.0.93 () {58 vars in 1023 bytes} [Tue Jul 26 14:36:55 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jul 26 14:36:55.345465 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910b2096-3cb8-47cd-b7fa-b0cdeb924c46 None None] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:36:55.358037 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910b2096-3cb8-47cd-b7fa-b0cdeb924c46 None None] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:36:55.362611 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bc2dea-43d6-4807-bddd-ef086aed3d9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f499667f2a194620a3504e461bf3cc25', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:36:55.363243 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bc2dea-43d6-4807-bddd-ef086aed3d9c admin admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:36:55.363525 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bc2dea-43d6-4807-bddd-ef086aed3d9c admin admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:36:55.364785 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bc2dea-43d6-4807-bddd-ef086aed3d9c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:36:55.373338 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bc2dea-43d6-4807-bddd-ef086aed3d9c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:36:55.375181 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bc2dea-43d6-4807-bddd-ef086aed3d9c admin admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:36:55.384101 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 5/8] 10.222.0.93 () {58 vars in 1324 bytes} [Tue Jul 26 14:36:55 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 26 14:36:55.390435 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584122d3-f0d3-44cf-8787-7298e904ec38 None None] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:36:55.400368 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584122d3-f0d3-44cf-8787-7298e904ec38 None None] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:36:55.405996 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d0d2dd-fab9-43de-9549-5728e0cbafba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f499667f2a194620a3504e461bf3cc25', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:36:55.406803 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d0d2dd-fab9-43de-9549-5728e0cbafba admin admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:36:55.407403 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d0d2dd-fab9-43de-9549-5728e0cbafba admin admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:36:55.407729 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d0d2dd-fab9-43de-9549-5728e0cbafba admin admin] PATH_INFO: `/v3/users/e5ef88cc058f425b882bcb87a1e1e75c` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:36:55.409254 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d0d2dd-fab9-43de-9549-5728e0cbafba admin admin] RBAC: Authorizing `identity:get_user(user_id=e5ef88cc058f425b882bcb87a1e1e75c)` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:36:55.411208 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d0d2dd-fab9-43de-9549-5728e0cbafba admin admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:36:55.412820 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 4/9] 10.222.0.93 () {56 vars in 1198 bytes} [Tue Jul 26 14:36:55 2022] GET /identity/v3/users/e5ef88cc058f425b882bcb87a1e1e75c => generated 247 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:36:57.607772 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04344ac7-0510-476b-b664-85f52cfb79d6 None None] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:36:57.608568 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04344ac7-0510-476b-b664-85f52cfb79d6 None None] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:36:57.608568 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04344ac7-0510-476b-b664-85f52cfb79d6 None None] PATH_INFO: `/` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:36:57.609962 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 6/10] 10.222.0.93 () {54 vars in 926 bytes} [Tue Jul 26 14:36:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 14:36:57.612537 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf000a99-d514-4399-b475-8fcc9922c353 None None] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:36:57.613305 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf000a99-d514-4399-b475-8fcc9922c353 None None] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:36:57.613305 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf000a99-d514-4399-b475-8fcc9922c353 None None] PATH_INFO: `/` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:36:57.614508 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 5/11] 10.222.0.93 () {54 vars in 926 bytes} [Tue Jul 26 14:36:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:36:57.619262 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3beab43b-b2a3-437c-837b-df1a88a4b677 None None] REQUEST_METHOD: `POST` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:36:57.620327 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3beab43b-b2a3-437c-837b-df1a88a4b677 None None] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:36:57.620837 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3beab43b-b2a3-437c-837b-df1a88a4b677 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:36:57.621123 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c296a100-9c8e-46b0-a01e-ab8793728bd2 None None] REQUEST_METHOD: `POST` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:36:57.621629 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c296a100-9c8e-46b0-a01e-ab8793728bd2 None None] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:36:57.622665 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c296a100-9c8e-46b0-a01e-ab8793728bd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:36:57.657247 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.auth.core [None req-c296a100-9c8e-46b0-a01e-ab8793728bd2 None None] MFA Rules not processed for user `e5ef88cc058f425b882bcb87a1e1e75c`. Rule list: `[]` (Enabled: `True`). {{(pid=87056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:36:57.659333 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.fernet_utils [None req-c296a100-9c8e-46b0-a01e-ab8793728bd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:36:57.689576 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG passlib.handlers.bcrypt [None req-3beab43b-b2a3-437c-837b-df1a88a4b677 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=87055) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 26 14:36:57.690001 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG passlib.handlers.bcrypt [None req-3beab43b-b2a3-437c-837b-df1a88a4b677 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=87055) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 26 14:36:57.737872 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.auth.core [None req-3beab43b-b2a3-437c-837b-df1a88a4b677 None None] MFA Rules not processed for user `e5ef88cc058f425b882bcb87a1e1e75c`. Rule list: `[]` (Enabled: `True`). {{(pid=87055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:36:57.739573 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.fernet_utils [None req-3beab43b-b2a3-437c-837b-df1a88a4b677 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:36:57.768048 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 6/12] 10.222.0.93 () {58 vars in 1023 bytes} [Tue Jul 26 14:36:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 14:36:57.790389 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c296a100-9c8e-46b0-a01e-ab8793728bd2 None None] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:36:57.819540 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:36:57.859395 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 7/13] 10.222.0.93 () {58 vars in 1023 bytes} [Tue Jul 26 14:36:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 14:36:57.883350 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3beab43b-b2a3-437c-837b-df1a88a4b677 None None] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:36:57.948254 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c296a100-9c8e-46b0-a01e-ab8793728bd2 None None] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:36:57.999199 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc80a70-91b5-4073-ab77-b248383c6c3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:36:58.000055 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc80a70-91b5-4073-ab77-b248383c6c3c None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:36:58.000431 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc80a70-91b5-4073-ab77-b248383c6c3c None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:36:58.000895 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc80a70-91b5-4073-ab77-b248383c6c3c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:36:58.018563 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3beab43b-b2a3-437c-837b-df1a88a4b677 None None] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:36:58.021454 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:36:58.069459 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d70f306-ee46-407a-b562-4119c87288be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:36:58.071449 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d70f306-ee46-407a-b562-4119c87288be None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:36:58.071967 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d70f306-ee46-407a-b562-4119c87288be None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:36:58.072479 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d70f306-ee46-407a-b562-4119c87288be None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:36:58.094212 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc80a70-91b5-4073-ab77-b248383c6c3c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:36:58.095756 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc80a70-91b5-4073-ab77-b248383c6c3c None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:36:58.098022 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d70f306-ee46-407a-b562-4119c87288be None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 14:36:58.114986 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application [None req-4d70f306-ee46-407a-b562-4119c87288be None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 14:36:58.114986 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:36:58.114986 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:36:58.114986 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:36:58.114986 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:36:58.114986 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:36:58.114986 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:36:58.114986 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:36:58.114986 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:36:58.114986 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:36:58.114986 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:36:58.114986 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:36:58.114986 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 14:36:58.114986 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 14:36:58.114986 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 14:36:58.114986 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 14:36:58.116507 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 14:36:58.116507 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 14:36:58.116507 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 14:36:58.116507 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 14:36:58.116507 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:36:58.116507 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:36:58.116507 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:36:58.116507 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:36:58.116507 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:36:58.116507 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:36:58.116507 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:36:58.116507 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application with Lock( Jul 26 14:36:58.116507 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:36:58.116507 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:36:58.116507 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:36:58.116507 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:36:58.117616 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:36:58.117616 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:36:58.117616 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:36:58.117616 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:36:58.117616 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 14:36:58.117616 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 14:36:58.117616 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 14:36:58.117616 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 14:36:58.117616 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 14:36:58.117616 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 14:36:58.117616 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 14:36:58.117616 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Jul 26 14:36:58.117616 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 8/14] 10.222.0.93 () {56 vars in 1096 bytes} [Tue Jul 26 14:36:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 14:36:58.127255 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:36:58.127660 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d70f306-ee46-407a-b562-4119c87288be None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:36:58.250284 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 7/15] 10.222.0.93 () {58 vars in 1282 bytes} [Tue Jul 26 14:36:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 460 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 26 14:36:58.251834 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d70f306-ee46-407a-b562-4119c87288be None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:36:58.256539 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc80a70-91b5-4073-ab77-b248383c6c3c None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:36:58.296852 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b2a88a-0e53-47f4-bd68-9b076f50a733 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:36:58.297707 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b2a88a-0e53-47f4-bd68-9b076f50a733 None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:36:58.298134 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b2a88a-0e53-47f4-bd68-9b076f50a733 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:36:58.298546 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b2a88a-0e53-47f4-bd68-9b076f50a733 None admin] PATH_INFO: `/v3/roles` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:36:58.299398 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b2a88a-0e53-47f4-bd68-9b076f50a733 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:36:58.299800 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b2a88a-0e53-47f4-bd68-9b076f50a733 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:36:58.301787 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b2a88a-0e53-47f4-bd68-9b076f50a733 None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:36:58.318270 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 9/16] 10.222.0.93 () {56 vars in 1099 bytes} [Tue Jul 26 14:36:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:36:58.325072 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b2a88a-0e53-47f4-bd68-9b076f50a733 None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:36:58.358032 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:36:58.401975 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc80a70-91b5-4073-ab77-b248383c6c3c None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:36:58.490225 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b2a88a-0e53-47f4-bd68-9b076f50a733 None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:36:58.533064 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc69730-cbe4-4f4b-8a83-0ee8041842f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:36:58.533724 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc69730-cbe4-4f4b-8a83-0ee8041842f2 None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:36:58.534011 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc69730-cbe4-4f4b-8a83-0ee8041842f2 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:36:58.534312 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc69730-cbe4-4f4b-8a83-0ee8041842f2 None admin] PATH_INFO: `/v3/users/e5ef88cc058f425b882bcb87a1e1e75c` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:36:58.535874 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc69730-cbe4-4f4b-8a83-0ee8041842f2 None admin] RBAC: Authorizing `identity:get_user(user_id=e5ef88cc058f425b882bcb87a1e1e75c)` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:36:58.537378 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc69730-cbe4-4f4b-8a83-0ee8041842f2 None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:36:58.539168 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 10/17] 10.222.0.93 () {56 vars in 1177 bytes} [Tue Jul 26 14:36:58 2022] GET /identity/v3/users/e5ef88cc058f425b882bcb87a1e1e75c => generated 247 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:36:58.542091 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:36:58.545523 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc69730-cbe4-4f4b-8a83-0ee8041842f2 None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:36:58.555656 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fe5036-157b-46a7-9a7b-83346c3d048e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:36:58.564585 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fe5036-157b-46a7-9a7b-83346c3d048e None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:36:58.564585 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fe5036-157b-46a7-9a7b-83346c3d048e None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:36:58.564585 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fe5036-157b-46a7-9a7b-83346c3d048e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:36:58.570402 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fe5036-157b-46a7-9a7b-83346c3d048e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:36:58.571928 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fe5036-157b-46a7-9a7b-83346c3d048e None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:36:58.592820 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application [None req-68fe5036-157b-46a7-9a7b-83346c3d048e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:36:58.592820 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:36:58.592820 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:36:58.592820 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:36:58.592820 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:36:58.592820 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:36:58.592820 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:36:58.592820 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:36:58.592820 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:36:58.592820 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:36:58.592820 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:36:58.592820 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:36:58.592820 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 14:36:58.592820 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 14:36:58.592820 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 14:36:58.594787 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 14:36:58.594787 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:36:58.594787 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:36:58.594787 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:36:58.594787 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:36:58.594787 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:36:58.594787 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:36:58.594787 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:36:58.594787 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application with Lock( Jul 26 14:36:58.594787 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:36:58.594787 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:36:58.594787 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:36:58.594787 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:36:58.594787 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:36:58.594787 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:36:58.594787 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:36:58.594787 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:36:58.596401 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 14:36:58.596401 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 14:36:58.596401 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:36:58.596401 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Jul 26 14:36:58.596401 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 8/18] 10.222.0.93 () {56 vars in 1108 bytes} [Tue Jul 26 14:36:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 339 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 14:36:58.602891 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fe5036-157b-46a7-9a7b-83346c3d048e None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:36:58.677131 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:36:58.688497 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc69730-cbe4-4f4b-8a83-0ee8041842f2 None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:36:58.729492 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fe5036-157b-46a7-9a7b-83346c3d048e None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:36:58.750512 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f0215b-00cd-464f-bf25-b409c17bce70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:36:58.751664 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f0215b-00cd-464f-bf25-b409c17bce70 None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:36:58.752160 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f0215b-00cd-464f-bf25-b409c17bce70 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:36:58.752660 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f0215b-00cd-464f-bf25-b409c17bce70 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:36:58.754955 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f0215b-00cd-464f-bf25-b409c17bce70 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:36:58.757774 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f0215b-00cd-464f-bf25-b409c17bce70 None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:36:58.761483 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 11/19] 10.222.0.93 () {56 vars in 1108 bytes} [Tue Jul 26 14:36:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:36:58.770150 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65212400-7e12-4f03-a168-b2388f5ec856 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:36:58.770819 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65212400-7e12-4f03-a168-b2388f5ec856 None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:36:58.771105 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65212400-7e12-4f03-a168-b2388f5ec856 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:36:58.771224 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f0215b-00cd-464f-bf25-b409c17bce70 None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:36:58.771389 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65212400-7e12-4f03-a168-b2388f5ec856 None admin] PATH_INFO: `/v3/domains` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:36:58.772096 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65212400-7e12-4f03-a168-b2388f5ec856 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:36:58.772404 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65212400-7e12-4f03-a168-b2388f5ec856 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:36:58.773905 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65212400-7e12-4f03-a168-b2388f5ec856 None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:36:58.798811 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 9/20] 10.222.0.93 () {56 vars in 1109 bytes} [Tue Jul 26 14:36:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:36:58.917086 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f0215b-00cd-464f-bf25-b409c17bce70 None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:36:58.959589 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc3f388-9d0c-41d0-a338-1ec62d380690 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:36:58.960152 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc3f388-9d0c-41d0-a338-1ec62d380690 None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:36:58.960434 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc3f388-9d0c-41d0-a338-1ec62d380690 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:36:58.960711 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc3f388-9d0c-41d0-a338-1ec62d380690 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:36:58.961546 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc3f388-9d0c-41d0-a338-1ec62d380690 None admin] RBAC: Adding query filter params (role.id=94e105ff8ee4486abd501415cc05ba38, scope.domain.id=default, user.id=e5ef88cc058f425b882bcb87a1e1e75c) {{(pid=87055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:36:58.961859 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc3f388-9d0c-41d0-a338-1ec62d380690 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:36:58.963582 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc3f388-9d0c-41d0-a338-1ec62d380690 None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:36:58.973321 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 12/21] 10.222.0.93 () {56 vars in 1322 bytes} [Tue Jul 26 14:36:58 2022] GET /identity/v3/role_assignments?user.id=e5ef88cc058f425b882bcb87a1e1e75c&scope.domain.id=default&role.id=94e105ff8ee4486abd501415cc05ba38 => generated 233 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:37:01.596644 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7aa57bb-f10b-4f51-9562-5bfd7f682b1e None None] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:01.597455 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7aa57bb-f10b-4f51-9562-5bfd7f682b1e None None] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:01.597455 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7aa57bb-f10b-4f51-9562-5bfd7f682b1e None None] PATH_INFO: `/` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:01.598661 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 10/22] 10.222.0.93 () {54 vars in 926 bytes} [Tue Jul 26 14:37:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:37:01.606386 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493ce8fa-c247-46a0-aa9c-0d746821c32c None None] REQUEST_METHOD: `POST` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:01.607839 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493ce8fa-c247-46a0-aa9c-0d746821c32c None None] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:01.608629 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493ce8fa-c247-46a0-aa9c-0d746821c32c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:01.650193 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.auth.core [None req-493ce8fa-c247-46a0-aa9c-0d746821c32c None None] MFA Rules not processed for user `e5ef88cc058f425b882bcb87a1e1e75c`. Rule list: `[]` (Enabled: `True`). {{(pid=87055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:37:01.653516 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.fernet_utils [None req-493ce8fa-c247-46a0-aa9c-0d746821c32c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:37:01.717803 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:37:01.844586 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 13/23] 10.222.0.93 () {58 vars in 1023 bytes} [Tue Jul 26 14:37:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 14:37:01.880164 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7aa57bb-f10b-4f51-9562-5bfd7f682b1e None None] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:37:01.943162 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:37:02.091438 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7aa57bb-f10b-4f51-9562-5bfd7f682b1e None None] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:37:02.163207 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975c07ed-b663-4361-b3f2-50145ad27d1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:37:02.163813 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975c07ed-b663-4361-b3f2-50145ad27d1f None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:02.164158 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975c07ed-b663-4361-b3f2-50145ad27d1f None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:02.164447 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975c07ed-b663-4361-b3f2-50145ad27d1f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:02.171828 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b819c38d-c24f-443e-8579-39f0cc69011f None None] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:02.172771 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b819c38d-c24f-443e-8579-39f0cc69011f None None] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:02.173580 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b819c38d-c24f-443e-8579-39f0cc69011f None None] PATH_INFO: `/` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:02.183078 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 14/24] 10.222.0.93 () {54 vars in 926 bytes} [Tue Jul 26 14:37:02 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:37:02.187665 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e409d56b-98ec-4406-80e3-a774dfc18ea9 None None] REQUEST_METHOD: `POST` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:02.188520 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e409d56b-98ec-4406-80e3-a774dfc18ea9 None None] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:02.189217 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e409d56b-98ec-4406-80e3-a774dfc18ea9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:02.191681 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975c07ed-b663-4361-b3f2-50145ad27d1f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 14:37:02.202814 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application [None req-975c07ed-b663-4361-b3f2-50145ad27d1f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 14:37:02.202814 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:37:02.202814 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:37:02.202814 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:37:02.202814 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:37:02.202814 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:37:02.202814 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:37:02.202814 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:37:02.202814 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:37:02.202814 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:37:02.202814 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:37:02.202814 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:37:02.202814 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 14:37:02.202814 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 14:37:02.202814 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 14:37:02.202814 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 14:37:02.204467 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 14:37:02.204467 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 14:37:02.204467 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 14:37:02.204467 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 14:37:02.204467 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:37:02.204467 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:37:02.204467 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:37:02.204467 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:37:02.204467 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:37:02.204467 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:37:02.204467 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:37:02.204467 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application with Lock( Jul 26 14:37:02.204467 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:37:02.204467 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:37:02.204467 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:37:02.204467 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:37:02.206691 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:37:02.206691 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:37:02.206691 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:37:02.206691 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:37:02.206691 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 14:37:02.206691 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 14:37:02.206691 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 14:37:02.206691 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 14:37:02.206691 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 14:37:02.206691 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 14:37:02.206691 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 14:37:02.206691 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Jul 26 14:37:02.206691 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 11/25] 10.222.0.93 () {56 vars in 1096 bytes} [Tue Jul 26 14:37:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 326 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 14:37:02.211247 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975c07ed-b663-4361-b3f2-50145ad27d1f None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:37:02.256570 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.auth.core [None req-e409d56b-98ec-4406-80e3-a774dfc18ea9 None None] MFA Rules not processed for user `e5ef88cc058f425b882bcb87a1e1e75c`. Rule list: `[]` (Enabled: `True`). {{(pid=87055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:37:02.265300 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.fernet_utils [None req-e409d56b-98ec-4406-80e3-a774dfc18ea9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:37:02.538333 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 15/26] 10.222.0.93 () {58 vars in 1023 bytes} [Tue Jul 26 14:37:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 347 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 14:37:02.553770 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b7bf74-9f17-46f5-ad0a-f9c0c29abeda None None] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:02.554796 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b7bf74-9f17-46f5-ad0a-f9c0c29abeda None None] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:02.555716 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b7bf74-9f17-46f5-ad0a-f9c0c29abeda None None] PATH_INFO: `/` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:02.559506 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 16/27] 10.222.0.93 () {54 vars in 926 bytes} [Tue Jul 26 14:37:02 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 14:37:02.568595 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5e9605-1e86-4ee7-9bee-50ac92581b8b None None] REQUEST_METHOD: `POST` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:02.569507 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5e9605-1e86-4ee7-9bee-50ac92581b8b None None] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:02.570316 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5e9605-1e86-4ee7-9bee-50ac92581b8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:02.588422 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:37:02.605974 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975c07ed-b663-4361-b3f2-50145ad27d1f None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:37:02.627676 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.auth.core [None req-4d5e9605-1e86-4ee7-9bee-50ac92581b8b None None] MFA Rules not processed for user `e5ef88cc058f425b882bcb87a1e1e75c`. Rule list: `[]` (Enabled: `True`). {{(pid=87055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:37:02.629687 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.fernet_utils [None req-4d5e9605-1e86-4ee7-9bee-50ac92581b8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:37:02.751925 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a01e0d8-78a1-4d5e-b65c-104876c3aada None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:37:02.752609 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a01e0d8-78a1-4d5e-b65c-104876c3aada None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:02.752898 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a01e0d8-78a1-4d5e-b65c-104876c3aada None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:02.753185 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a01e0d8-78a1-4d5e-b65c-104876c3aada None admin] PATH_INFO: `/v3/roles` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:02.754004 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a01e0d8-78a1-4d5e-b65c-104876c3aada None admin] RBAC: Adding query filter params (name=admin) {{(pid=87056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:37:02.754348 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a01e0d8-78a1-4d5e-b65c-104876c3aada None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:37:02.755837 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a01e0d8-78a1-4d5e-b65c-104876c3aada None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:37:02.787585 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 12/28] 10.222.0.93 () {56 vars in 1099 bytes} [Tue Jul 26 14:37:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 577 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:37:02.788272 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a01e0d8-78a1-4d5e-b65c-104876c3aada None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:37:02.957296 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a01e0d8-78a1-4d5e-b65c-104876c3aada None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:37:02.979230 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 17/29] 10.222.0.93 () {58 vars in 1023 bytes} [Tue Jul 26 14:37:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 412 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 14:37:02.980592 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5e9605-1e86-4ee7-9bee-50ac92581b8b None None] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:37:03.033731 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:37:03.057471 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdb4cbd-3109-4bd0-b4f4-593c5b7f7179 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:37:03.058343 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdb4cbd-3109-4bd0-b4f4-593c5b7f7179 None admin] REQUEST_METHOD: `POST` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:03.058636 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdb4cbd-3109-4bd0-b4f4-593c5b7f7179 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:03.058916 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdb4cbd-3109-4bd0-b4f4-593c5b7f7179 None admin] PATH_INFO: `/v3/roles` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:03.059677 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdb4cbd-3109-4bd0-b4f4-593c5b7f7179 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:37:03.061147 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdb4cbd-3109-4bd0-b4f4-593c5b7f7179 None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:37:03.188838 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5e9605-1e86-4ee7-9bee-50ac92581b8b None None] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:37:03.259821 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fd462c-9922-4a45-acd8-44bc0b2780d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:37:03.261093 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fd462c-9922-4a45-acd8-44bc0b2780d5 None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:03.261594 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fd462c-9922-4a45-acd8-44bc0b2780d5 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:03.262092 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fd462c-9922-4a45-acd8-44bc0b2780d5 None admin] PATH_INFO: `/v3/users/e5ef88cc058f425b882bcb87a1e1e75c` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:03.264330 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fd462c-9922-4a45-acd8-44bc0b2780d5 None admin] RBAC: Authorizing `identity:get_user(user_id=e5ef88cc058f425b882bcb87a1e1e75c)` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:37:03.266993 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fd462c-9922-4a45-acd8-44bc0b2780d5 None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:37:03.270286 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 18/30] 10.222.0.93 () {56 vars in 1177 bytes} [Tue Jul 26 14:37:02 2022] GET /identity/v3/users/e5ef88cc058f425b882bcb87a1e1e75c => generated 247 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:37:03.271807 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fd462c-9922-4a45-acd8-44bc0b2780d5 None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:37:03.326280 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 13/31] 10.222.0.93 () {60 vars in 1131 bytes} [Tue Jul 26 14:37:02 2022] POST /identity/v3/roles => generated 219 bytes in 538 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 14:37:03.327924 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a799aabb-22b6-4303-bdb6-32a908586568 None None] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:03.328220 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a799aabb-22b6-4303-bdb6-32a908586568 None None] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:03.328505 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a799aabb-22b6-4303-bdb6-32a908586568 None None] PATH_INFO: `/` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:03.330355 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 14/32] 10.222.0.93 () {54 vars in 926 bytes} [Tue Jul 26 14:37:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:37:03.335627 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a799aabb-22b6-4303-bdb6-32a908586568 None None] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:37:03.365789 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:37:03.493263 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:37:03.534417 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fd462c-9922-4a45-acd8-44bc0b2780d5 None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:37:03.550224 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a799aabb-22b6-4303-bdb6-32a908586568 None None] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:37:03.587354 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc02e4fb-645a-459c-8a7b-2c637e6a81c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:37:03.587798 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc02e4fb-645a-459c-8a7b-2c637e6a81c8 None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:03.589375 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc02e4fb-645a-459c-8a7b-2c637e6a81c8 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:03.589375 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc02e4fb-645a-459c-8a7b-2c637e6a81c8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:03.625784 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc02e4fb-645a-459c-8a7b-2c637e6a81c8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:37:03.627490 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc02e4fb-645a-459c-8a7b-2c637e6a81c8 None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:37:03.628572 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1996496-6611-4d47-bb62-0002ced24a24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:37:03.630986 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1996496-6611-4d47-bb62-0002ced24a24 None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:03.631538 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1996496-6611-4d47-bb62-0002ced24a24 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:03.632086 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1996496-6611-4d47-bb62-0002ced24a24 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:03.634564 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1996496-6611-4d47-bb62-0002ced24a24 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:37:03.637090 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1996496-6611-4d47-bb62-0002ced24a24 None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:37:03.639857 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 15/33] 10.222.0.93 () {56 vars in 1108 bytes} [Tue Jul 26 14:37:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:37:03.641802 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21d61a3-a47f-485f-98d5-54df78452687 None None] REQUEST_METHOD: `POST` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:03.642149 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21d61a3-a47f-485f-98d5-54df78452687 None None] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:03.642673 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21d61a3-a47f-485f-98d5-54df78452687 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:03.649574 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application [None req-cc02e4fb-645a-459c-8a7b-2c637e6a81c8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:37:03.649574 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:37:03.649574 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:37:03.649574 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:37:03.649574 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:37:03.649574 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:37:03.649574 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:37:03.649574 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:37:03.649574 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:37:03.649574 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:37:03.649574 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:37:03.649574 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:37:03.649574 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 14:37:03.649574 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 14:37:03.649574 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 14:37:03.652172 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 14:37:03.652172 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:37:03.652172 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:37:03.652172 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:37:03.652172 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:37:03.652172 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:37:03.652172 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:37:03.652172 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:37:03.652172 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application with Lock( Jul 26 14:37:03.652172 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:37:03.652172 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:37:03.652172 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:37:03.652172 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:37:03.652172 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:37:03.652172 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:37:03.652172 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:37:03.652172 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:37:03.653160 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 14:37:03.653160 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 14:37:03.653160 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:37:03.653160 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Jul 26 14:37:03.654619 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 19/34] 10.222.0.93 () {56 vars in 1108 bytes} [Tue Jul 26 14:37:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 383 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:37:03.655916 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0502e8f-1a59-45a2-9a39-f29c68c923cf None None] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:03.656203 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0502e8f-1a59-45a2-9a39-f29c68c923cf None None] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:03.656511 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0502e8f-1a59-45a2-9a39-f29c68c923cf None None] PATH_INFO: `/` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:03.658806 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 20/35] 10.222.0.93 () {54 vars in 926 bytes} [Tue Jul 26 14:37:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:37:03.663559 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0502e8f-1a59-45a2-9a39-f29c68c923cf None None] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:37:03.673647 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.auth.core [None req-b21d61a3-a47f-485f-98d5-54df78452687 None None] MFA Rules not processed for user `e5ef88cc058f425b882bcb87a1e1e75c`. Rule list: `[]` (Enabled: `True`). {{(pid=87056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:37:03.675487 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.fernet_utils [None req-b21d61a3-a47f-485f-98d5-54df78452687 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:37:03.779012 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 16/36] 10.222.0.93 () {58 vars in 1023 bytes} [Tue Jul 26 14:37:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 14:37:03.780350 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ffc178-d39d-42db-89c4-30f37a156efb None None] REQUEST_METHOD: `POST` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:03.780634 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ffc178-d39d-42db-89c4-30f37a156efb None None] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:03.780918 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ffc178-d39d-42db-89c4-30f37a156efb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:03.804711 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.auth.core [None req-c5ffc178-d39d-42db-89c4-30f37a156efb None None] MFA Rules not processed for user `e5ef88cc058f425b882bcb87a1e1e75c`. Rule list: `[]` (Enabled: `True`). {{(pid=87056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:37:03.805824 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.fernet_utils [None req-c5ffc178-d39d-42db-89c4-30f37a156efb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:37:03.817694 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:37:03.819996 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0502e8f-1a59-45a2-9a39-f29c68c923cf None None] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:37:03.863829 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95deb70-0a67-48b3-8fd2-2d2effe963f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:37:03.864659 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95deb70-0a67-48b3-8fd2-2d2effe963f2 None admin] REQUEST_METHOD: `PUT` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:03.865008 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95deb70-0a67-48b3-8fd2-2d2effe963f2 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:03.865451 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95deb70-0a67-48b3-8fd2-2d2effe963f2 None admin] PATH_INFO: `/v3/domains/default/users/e5ef88cc058f425b882bcb87a1e1e75c/roles/94e105ff8ee4486abd501415cc05ba38` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:03.868002 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95deb70-0a67-48b3-8fd2-2d2effe963f2 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=e5ef88cc058f425b882bcb87a1e1e75c, role_id=94e105ff8ee4486abd501415cc05ba38)` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:37:03.869928 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95deb70-0a67-48b3-8fd2-2d2effe963f2 None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:37:03.878198 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:37:03.888752 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 17/37] 10.222.0.93 () {58 vars in 1023 bytes} [Tue Jul 26 14:37:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 14:37:03.889724 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ffc178-d39d-42db-89c4-30f37a156efb None None] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:37:04.000660 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ffc178-d39d-42db-89c4-30f37a156efb None None] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:37:04.038695 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f87694-ab94-46c0-bcec-fb7006dd9526 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:37:04.039338 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f87694-ab94-46c0-bcec-fb7006dd9526 None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:04.039620 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f87694-ab94-46c0-bcec-fb7006dd9526 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:04.039893 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f87694-ab94-46c0-bcec-fb7006dd9526 None admin] PATH_INFO: `/v3/domains` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:04.040617 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f87694-ab94-46c0-bcec-fb7006dd9526 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:37:04.040923 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f87694-ab94-46c0-bcec-fb7006dd9526 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:37:04.043026 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f87694-ab94-46c0-bcec-fb7006dd9526 None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:37:04.055672 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 18/38] 10.222.0.93 () {56 vars in 1109 bytes} [Tue Jul 26 14:37:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:37:04.056950 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1e5fa8-3c7f-4f36-918e-5c3baaa1c769 None None] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:04.057375 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1e5fa8-3c7f-4f36-918e-5c3baaa1c769 None None] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:04.057733 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1e5fa8-3c7f-4f36-918e-5c3baaa1c769 None None] PATH_INFO: `/` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:04.059440 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 19/39] 10.222.0.93 () {54 vars in 926 bytes} [Tue Jul 26 14:37:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:37:04.059934 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1e5fa8-3c7f-4f36-918e-5c3baaa1c769 None None] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:37:04.064093 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:37:04.178070 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1e5fa8-3c7f-4f36-918e-5c3baaa1c769 None None] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:37:04.201569 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 21/40] 10.222.0.93 () {58 vars in 1361 bytes} [Tue Jul 26 14:37:03 2022] PUT /identity/v3/domains/default/users/e5ef88cc058f425b882bcb87a1e1e75c/roles/94e105ff8ee4486abd501415cc05ba38 => generated 0 bytes in 543 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 14:37:04.202906 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95deb70-0a67-48b3-8fd2-2d2effe963f2 None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:37:04.226099 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236a04bd-0a11-40ca-82a3-cb4e8b53efcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:37:04.226960 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236a04bd-0a11-40ca-82a3-cb4e8b53efcd None admin] REQUEST_METHOD: `POST` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:04.227301 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236a04bd-0a11-40ca-82a3-cb4e8b53efcd None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:04.227588 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236a04bd-0a11-40ca-82a3-cb4e8b53efcd None admin] PATH_INFO: `/v3/roles` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:04.228354 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236a04bd-0a11-40ca-82a3-cb4e8b53efcd None admin] RBAC: Authorizing `identity:create_role()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:37:04.229974 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236a04bd-0a11-40ca-82a3-cb4e8b53efcd None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:37:04.365896 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95deb70-0a67-48b3-8fd2-2d2effe963f2 None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:37:04.377617 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 20/41] 10.222.0.93 () {60 vars in 1131 bytes} [Tue Jul 26 14:37:04 2022] POST /identity/v3/roles => generated 225 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 14:37:04.381713 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236a04bd-0a11-40ca-82a3-cb4e8b53efcd None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:37:04.445516 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a556e9a-398a-48fb-8ad8-7089618b4fe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:37:04.446714 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a556e9a-398a-48fb-8ad8-7089618b4fe5 None admin] REQUEST_METHOD: `POST` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:04.447251 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a556e9a-398a-48fb-8ad8-7089618b4fe5 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:04.448319 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a556e9a-398a-48fb-8ad8-7089618b4fe5 None admin] PATH_INFO: `/v3/roles` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:04.449809 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a556e9a-398a-48fb-8ad8-7089618b4fe5 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:37:04.453176 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a556e9a-398a-48fb-8ad8-7089618b4fe5 None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:37:04.518736 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:37:04.578507 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 22/42] 10.222.0.93 () {60 vars in 1131 bytes} [Tue Jul 26 14:37:04 2022] POST /identity/v3/roles => generated 223 bytes in 376 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 14:37:04.580978 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc60fc9-430c-4531-894a-c7d75d057547 None None] REQUEST_METHOD: `POST` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:04.581373 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc60fc9-430c-4531-894a-c7d75d057547 None None] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:04.581621 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc60fc9-430c-4531-894a-c7d75d057547 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:04.594734 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236a04bd-0a11-40ca-82a3-cb4e8b53efcd None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:37:04.607153 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.auth.core [None req-1bc60fc9-430c-4531-894a-c7d75d057547 None None] MFA Rules not processed for user `e5ef88cc058f425b882bcb87a1e1e75c`. Rule list: `[]` (Enabled: `True`). {{(pid=87055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:37:04.607153 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.fernet_utils [None req-1bc60fc9-430c-4531-894a-c7d75d057547 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:37:04.644699 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fee8577-5147-440b-9d9d-3aca771ffc5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:37:04.645629 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fee8577-5147-440b-9d9d-3aca771ffc5e None admin] REQUEST_METHOD: `POST` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:04.645629 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fee8577-5147-440b-9d9d-3aca771ffc5e None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:04.646087 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fee8577-5147-440b-9d9d-3aca771ffc5e None admin] PATH_INFO: `/v3/projects` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:04.647248 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fee8577-5147-440b-9d9d-3aca771ffc5e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:37:04.651214 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fee8577-5147-440b-9d9d-3aca771ffc5e None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:37:04.680188 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:37:04.709079 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 23/43] 10.222.0.93 () {58 vars in 1023 bytes} [Tue Jul 26 14:37:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 14:37:04.735142 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc60fc9-430c-4531-894a-c7d75d057547 None None] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:37:04.785622 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 21/44] 10.222.0.93 () {60 vars in 1141 bytes} [Tue Jul 26 14:37:04 2022] POST /identity/v3/projects => generated 301 bytes in 407 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 14:37:04.872211 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc60fc9-430c-4531-894a-c7d75d057547 None None] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:37:04.916915 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37733b6-3d9a-42bd-b2fe-525b6e0839af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:37:04.917512 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37733b6-3d9a-42bd-b2fe-525b6e0839af None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:04.917884 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37733b6-3d9a-42bd-b2fe-525b6e0839af None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:04.918188 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37733b6-3d9a-42bd-b2fe-525b6e0839af None admin] PATH_INFO: `/v3/domains/default` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:04.919619 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37733b6-3d9a-42bd-b2fe-525b6e0839af None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:37:04.921155 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37733b6-3d9a-42bd-b2fe-525b6e0839af None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:37:04.922974 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 24/45] 10.222.0.93 () {56 vars in 1108 bytes} [Tue Jul 26 14:37:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:37:04.929369 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fee8577-5147-440b-9d9d-3aca771ffc5e None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:37:05.087328 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fee8577-5147-440b-9d9d-3aca771ffc5e None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:37:05.109871 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:37:05.132967 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4b1e30-d2d8-453c-ab47-7c569c1421d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:37:05.133776 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4b1e30-d2d8-453c-ab47-7c569c1421d7 None admin] REQUEST_METHOD: `POST` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:05.134179 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4b1e30-d2d8-453c-ab47-7c569c1421d7 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:05.134617 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4b1e30-d2d8-453c-ab47-7c569c1421d7 None admin] PATH_INFO: `/v3/projects` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:05.136041 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4b1e30-d2d8-453c-ab47-7c569c1421d7 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:37:05.137666 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4b1e30-d2d8-453c-ab47-7c569c1421d7 None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:37:05.320691 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 22/46] 10.222.0.93 () {60 vars in 1141 bytes} [Tue Jul 26 14:37:04 2022] POST /identity/v3/projects => generated 312 bytes in 392 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 14:37:06.734149 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c7e7b7-23e0-4a4b-b597-8dfcc1e34edb None None] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:06.735083 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c7e7b7-23e0-4a4b-b597-8dfcc1e34edb None None] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:06.735318 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c7e7b7-23e0-4a4b-b597-8dfcc1e34edb None None] PATH_INFO: `/` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:06.737759 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 25/47] 10.222.0.93 () {54 vars in 926 bytes} [Tue Jul 26 14:37:06 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:37:06.747267 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64eb928a-4d49-45fa-ad4a-7ad2c4b60f8e None None] REQUEST_METHOD: `POST` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:06.747844 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64eb928a-4d49-45fa-ad4a-7ad2c4b60f8e None None] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:06.748194 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64eb928a-4d49-45fa-ad4a-7ad2c4b60f8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:06.774691 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.auth.core [None req-64eb928a-4d49-45fa-ad4a-7ad2c4b60f8e None None] MFA Rules not processed for user `e5ef88cc058f425b882bcb87a1e1e75c`. Rule list: `[]` (Enabled: `True`). {{(pid=87056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:37:06.778380 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.fernet_utils [None req-64eb928a-4d49-45fa-ad4a-7ad2c4b60f8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:37:06.875916 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 23/48] 10.222.0.93 () {58 vars in 1023 bytes} [Tue Jul 26 14:37:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 14:37:06.900639 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c7e7b7-23e0-4a4b-b597-8dfcc1e34edb None None] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:37:06.975405 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:37:07.039890 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c7e7b7-23e0-4a4b-b597-8dfcc1e34edb None None] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:37:07.084253 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37a7908-02d0-4cb7-9aec-2fa3285f684f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:37:07.084920 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37a7908-02d0-4cb7-9aec-2fa3285f684f None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:07.085203 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37a7908-02d0-4cb7-9aec-2fa3285f684f None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:07.085480 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37a7908-02d0-4cb7-9aec-2fa3285f684f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:07.099297 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37a7908-02d0-4cb7-9aec-2fa3285f684f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 14:37:07.105929 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application [None req-f37a7908-02d0-4cb7-9aec-2fa3285f684f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 14:37:07.105929 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:37:07.105929 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:37:07.105929 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:37:07.105929 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:37:07.105929 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:37:07.105929 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:37:07.105929 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:37:07.105929 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:37:07.105929 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:37:07.105929 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:37:07.105929 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:37:07.105929 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 14:37:07.105929 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 14:37:07.105929 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 14:37:07.105929 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 14:37:07.107899 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 14:37:07.107899 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 14:37:07.107899 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 14:37:07.107899 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 14:37:07.107899 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:37:07.107899 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:37:07.107899 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:37:07.107899 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:37:07.107899 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:37:07.107899 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:37:07.107899 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:37:07.107899 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application with Lock( Jul 26 14:37:07.107899 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:37:07.107899 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:37:07.107899 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:37:07.107899 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:37:07.109647 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:37:07.109647 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:37:07.109647 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:37:07.109647 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:37:07.109647 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 14:37:07.109647 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 14:37:07.109647 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 14:37:07.109647 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 14:37:07.109647 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 14:37:07.109647 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 14:37:07.109647 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 14:37:07.109647 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Jul 26 14:37:07.109647 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 26/49] 10.222.0.93 () {56 vars in 1096 bytes} [Tue Jul 26 14:37:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:37:07.113305 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64eb928a-4d49-45fa-ad4a-7ad2c4b60f8e None None] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:37:07.236799 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:37:07.241078 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64eb928a-4d49-45fa-ad4a-7ad2c4b60f8e None None] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:37:07.283840 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2c4461-12f5-4552-9bf1-6a841e61cabe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:37:07.284623 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2c4461-12f5-4552-9bf1-6a841e61cabe None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:07.284925 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2c4461-12f5-4552-9bf1-6a841e61cabe None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:07.285358 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2c4461-12f5-4552-9bf1-6a841e61cabe None admin] PATH_INFO: `/v3/roles` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:07.286174 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2c4461-12f5-4552-9bf1-6a841e61cabe None admin] RBAC: Adding query filter params (name=admin) {{(pid=87056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:37:07.286548 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2c4461-12f5-4552-9bf1-6a841e61cabe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:37:07.291603 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2c4461-12f5-4552-9bf1-6a841e61cabe None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:37:07.298394 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 24/50] 10.222.0.93 () {56 vars in 1099 bytes} [Tue Jul 26 14:37:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:37:07.305007 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37a7908-02d0-4cb7-9aec-2fa3285f684f None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:37:07.472181 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37a7908-02d0-4cb7-9aec-2fa3285f684f None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:37:07.477248 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257df3ac-ba4b-4258-965e-ff0b3d6655ad None None] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:07.477684 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257df3ac-ba4b-4258-965e-ff0b3d6655ad None None] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:07.478114 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257df3ac-ba4b-4258-965e-ff0b3d6655ad None None] PATH_INFO: `/` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:07.481176 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 25/51] 10.222.0.93 () {54 vars in 926 bytes} [Tue Jul 26 14:37:07 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 14:37:07.486965 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0e98ef-5399-4de7-916a-83ddb14c3de3 None None] REQUEST_METHOD: `POST` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:07.487177 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0e98ef-5399-4de7-916a-83ddb14c3de3 None None] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:07.487459 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0e98ef-5399-4de7-916a-83ddb14c3de3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:07.491173 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:37:07.509101 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.auth.core [None req-ff0e98ef-5399-4de7-916a-83ddb14c3de3 None None] MFA Rules not processed for user `e5ef88cc058f425b882bcb87a1e1e75c`. Rule list: `[]` (Enabled: `True`). {{(pid=87056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:37:07.513726 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.fernet_utils [None req-ff0e98ef-5399-4de7-916a-83ddb14c3de3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:37:07.528126 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9feedf1-aab2-43ad-b81d-bd03f0c11267 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:37:07.528908 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9feedf1-aab2-43ad-b81d-bd03f0c11267 None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:07.529188 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9feedf1-aab2-43ad-b81d-bd03f0c11267 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:07.535584 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9feedf1-aab2-43ad-b81d-bd03f0c11267 None admin] PATH_INFO: `/v3/users/e5ef88cc058f425b882bcb87a1e1e75c` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:07.535584 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9feedf1-aab2-43ad-b81d-bd03f0c11267 None admin] RBAC: Authorizing `identity:get_user(user_id=e5ef88cc058f425b882bcb87a1e1e75c)` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:37:07.535584 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9feedf1-aab2-43ad-b81d-bd03f0c11267 None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:37:07.535584 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 27/52] 10.222.0.93 () {56 vars in 1177 bytes} [Tue Jul 26 14:37:07 2022] GET /identity/v3/users/e5ef88cc058f425b882bcb87a1e1e75c => generated 247 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:37:07.540718 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9feedf1-aab2-43ad-b81d-bd03f0c11267 None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:37:07.600676 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 26/53] 10.222.0.93 () {58 vars in 1023 bytes} [Tue Jul 26 14:37:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 14:37:07.629787 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0e98ef-5399-4de7-916a-83ddb14c3de3 None None] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:37:07.696521 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9feedf1-aab2-43ad-b81d-bd03f0c11267 None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:37:07.744198 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db705ec-7ab0-43a9-947b-3a51edbb61c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:37:07.745983 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db705ec-7ab0-43a9-947b-3a51edbb61c5 None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:07.746186 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db705ec-7ab0-43a9-947b-3a51edbb61c5 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:07.746739 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db705ec-7ab0-43a9-947b-3a51edbb61c5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:07.748502 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db705ec-7ab0-43a9-947b-3a51edbb61c5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:37:07.750285 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db705ec-7ab0-43a9-947b-3a51edbb61c5 None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:37:07.752474 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 28/54] 10.222.0.93 () {56 vars in 1108 bytes} [Tue Jul 26 14:37:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:37:07.758857 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db705ec-7ab0-43a9-947b-3a51edbb61c5 None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:37:07.762201 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:37:07.774303 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0e98ef-5399-4de7-916a-83ddb14c3de3 None None] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:37:07.827211 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124eaacd-bc62-429c-8d79-66bee552e740 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:37:07.828404 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124eaacd-bc62-429c-8d79-66bee552e740 None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:07.828862 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124eaacd-bc62-429c-8d79-66bee552e740 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:07.829316 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124eaacd-bc62-429c-8d79-66bee552e740 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:07.831630 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124eaacd-bc62-429c-8d79-66bee552e740 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:37:07.833782 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124eaacd-bc62-429c-8d79-66bee552e740 None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:37:07.836642 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 27/55] 10.222.0.93 () {56 vars in 1108 bytes} [Tue Jul 26 14:37:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:37:07.845971 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124eaacd-bc62-429c-8d79-66bee552e740 None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:37:07.851540 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:37:07.920845 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db705ec-7ab0-43a9-947b-3a51edbb61c5 None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:37:07.970183 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fddc866-2f60-4cf0-9d7a-0a0985524ee5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:37:07.970848 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fddc866-2f60-4cf0-9d7a-0a0985524ee5 None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:07.971136 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fddc866-2f60-4cf0-9d7a-0a0985524ee5 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:07.971418 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fddc866-2f60-4cf0-9d7a-0a0985524ee5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:07.972239 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fddc866-2f60-4cf0-9d7a-0a0985524ee5 None admin] RBAC: Adding query filter params (role.id=94e105ff8ee4486abd501415cc05ba38, scope.domain.id=default, user.id=e5ef88cc058f425b882bcb87a1e1e75c) {{(pid=87055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:37:07.972550 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fddc866-2f60-4cf0-9d7a-0a0985524ee5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:37:07.974057 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fddc866-2f60-4cf0-9d7a-0a0985524ee5 None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:37:07.994854 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 29/56] 10.222.0.93 () {56 vars in 1322 bytes} [Tue Jul 26 14:37:07 2022] GET /identity/v3/role_assignments?user.id=e5ef88cc058f425b882bcb87a1e1e75c&scope.domain.id=default&role.id=94e105ff8ee4486abd501415cc05ba38 => generated 530 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:37:07.995085 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124eaacd-bc62-429c-8d79-66bee552e740 None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:37:08.036765 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c3728d-50a5-4c06-bb0e-b2a12893cc38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:37:08.037892 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c3728d-50a5-4c06-bb0e-b2a12893cc38 None admin] REQUEST_METHOD: `POST` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:08.038437 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c3728d-50a5-4c06-bb0e-b2a12893cc38 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:08.038927 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c3728d-50a5-4c06-bb0e-b2a12893cc38 None admin] PATH_INFO: `/v3/projects` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:08.040183 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c3728d-50a5-4c06-bb0e-b2a12893cc38 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:37:08.043605 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c3728d-50a5-4c06-bb0e-b2a12893cc38 None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:37:08.161188 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 28/57] 10.222.0.93 () {60 vars in 1140 bytes} [Tue Jul 26 14:37:07 2022] POST /identity/v3/projects => generated 298 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 14:37:10.328628 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf043b2-976c-4a86-b5d2-feb39fe30d60 None None] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:10.329189 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf043b2-976c-4a86-b5d2-feb39fe30d60 None None] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:10.329189 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf043b2-976c-4a86-b5d2-feb39fe30d60 None None] PATH_INFO: `/` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:10.340015 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 30/58] 10.222.0.93 () {54 vars in 926 bytes} [Tue Jul 26 14:37:10 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 14:37:10.348422 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89511987-3445-475f-a31b-acc446907e0b None None] REQUEST_METHOD: `POST` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:10.348980 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89511987-3445-475f-a31b-acc446907e0b None None] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:10.349081 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89511987-3445-475f-a31b-acc446907e0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:10.372239 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.auth.core [None req-89511987-3445-475f-a31b-acc446907e0b None None] MFA Rules not processed for user `e5ef88cc058f425b882bcb87a1e1e75c`. Rule list: `[]` (Enabled: `True`). {{(pid=87056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:37:10.373481 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.fernet_utils [None req-89511987-3445-475f-a31b-acc446907e0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:37:10.376856 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:37:10.451672 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 29/59] 10.222.0.93 () {58 vars in 1023 bytes} [Tue Jul 26 14:37:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 14:37:10.479607 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf043b2-976c-4a86-b5d2-feb39fe30d60 None None] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:37:10.602484 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf043b2-976c-4a86-b5d2-feb39fe30d60 None None] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:37:10.619081 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:37:10.640743 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3eee3a9-a9bf-4993-9160-8db41a1c165e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:37:10.641445 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3eee3a9-a9bf-4993-9160-8db41a1c165e None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:10.641819 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3eee3a9-a9bf-4993-9160-8db41a1c165e None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:10.642121 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3eee3a9-a9bf-4993-9160-8db41a1c165e None admin] PATH_INFO: `/v3/domains/default` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:10.643360 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3eee3a9-a9bf-4993-9160-8db41a1c165e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:37:10.644824 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3eee3a9-a9bf-4993-9160-8db41a1c165e None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:37:10.646517 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 31/60] 10.222.0.93 () {56 vars in 1108 bytes} [Tue Jul 26 14:37:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:37:10.653453 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89511987-3445-475f-a31b-acc446907e0b None None] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:37:10.767163 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89511987-3445-475f-a31b-acc446907e0b None None] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:37:10.805256 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7563c620-e72d-4c96-b5a3-14ee8538292c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:37:10.805897 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7563c620-e72d-4c96-b5a3-14ee8538292c None admin] REQUEST_METHOD: `POST` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:10.806184 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7563c620-e72d-4c96-b5a3-14ee8538292c None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:10.806523 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7563c620-e72d-4c96-b5a3-14ee8538292c None admin] PATH_INFO: `/v3/users` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:10.807791 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7563c620-e72d-4c96-b5a3-14ee8538292c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:37:10.809480 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7563c620-e72d-4c96-b5a3-14ee8538292c None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:37:10.827672 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:37:10.947750 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 30/61] 10.222.0.93 () {60 vars in 1132 bytes} [Tue Jul 26 14:37:10 2022] POST /identity/v3/users => generated 275 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 14:37:14.921709 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233a74e4-e9b6-4a41-bd96-7345938b1b13 None None] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:14.922638 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233a74e4-e9b6-4a41-bd96-7345938b1b13 None None] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:14.923079 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233a74e4-e9b6-4a41-bd96-7345938b1b13 None None] PATH_INFO: `/` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:14.924704 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 32/62] 10.222.0.93 () {54 vars in 926 bytes} [Tue Jul 26 14:37:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:37:14.933355 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690c347f-f951-4671-9892-0472441f3a84 None None] REQUEST_METHOD: `POST` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:14.934331 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690c347f-f951-4671-9892-0472441f3a84 None None] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:14.934764 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690c347f-f951-4671-9892-0472441f3a84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:14.960741 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.auth.core [None req-690c347f-f951-4671-9892-0472441f3a84 None None] MFA Rules not processed for user `e5ef88cc058f425b882bcb87a1e1e75c`. Rule list: `[]` (Enabled: `True`). {{(pid=87056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:37:14.962194 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.fernet_utils [None req-690c347f-f951-4671-9892-0472441f3a84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:37:15.067097 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 31/63] 10.222.0.93 () {58 vars in 1023 bytes} [Tue Jul 26 14:37:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 14:37:15.130343 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233a74e4-e9b6-4a41-bd96-7345938b1b13 None None] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:37:15.154184 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5e01a2-428b-4d7c-8ee7-186260142ba0 None None] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:15.154731 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5e01a2-428b-4d7c-8ee7-186260142ba0 None None] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:15.155156 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5e01a2-428b-4d7c-8ee7-186260142ba0 None None] PATH_INFO: `/` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:15.156820 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 32/64] 10.222.0.93 () {54 vars in 926 bytes} [Tue Jul 26 14:37:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 14:37:15.163129 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8564411-01ea-40af-a9c2-9799f0682564 None None] REQUEST_METHOD: `POST` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:15.163718 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8564411-01ea-40af-a9c2-9799f0682564 None None] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:15.164173 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8564411-01ea-40af-a9c2-9799f0682564 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:15.198702 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.auth.core [None req-a8564411-01ea-40af-a9c2-9799f0682564 None None] MFA Rules not processed for user `e5ef88cc058f425b882bcb87a1e1e75c`. Rule list: `[]` (Enabled: `True`). {{(pid=87056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:37:15.200025 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.fernet_utils [None req-a8564411-01ea-40af-a9c2-9799f0682564 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:37:15.330886 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233a74e4-e9b6-4a41-bd96-7345938b1b13 None None] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:37:15.338586 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 33/65] 10.222.0.93 () {58 vars in 1023 bytes} [Tue Jul 26 14:37:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 14:37:15.341495 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7b67d0-f599-4396-8eee-0dd0ff217027 None None] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:15.342363 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7b67d0-f599-4396-8eee-0dd0ff217027 None None] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:15.343096 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7b67d0-f599-4396-8eee-0dd0ff217027 None None] PATH_INFO: `/` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:15.346019 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 34/66] 10.222.0.93 () {54 vars in 926 bytes} [Tue Jul 26 14:37:15 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:37:15.355287 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ee7d47-d883-4503-9d99-cf1b755bf2f5 None None] REQUEST_METHOD: `POST` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:15.356223 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ee7d47-d883-4503-9d99-cf1b755bf2f5 None None] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:15.356970 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ee7d47-d883-4503-9d99-cf1b755bf2f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:15.378149 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65bc619-a986-4af9-920c-b8bf8c352e70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:37:15.378879 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65bc619-a986-4af9-920c-b8bf8c352e70 None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:15.379167 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65bc619-a986-4af9-920c-b8bf8c352e70 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:15.379445 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65bc619-a986-4af9-920c-b8bf8c352e70 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:15.392183 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.auth.core [None req-a5ee7d47-d883-4503-9d99-cf1b755bf2f5 None None] MFA Rules not processed for user `e5ef88cc058f425b882bcb87a1e1e75c`. Rule list: `[]` (Enabled: `True`). {{(pid=87056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:37:15.394529 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.fernet_utils [None req-a5ee7d47-d883-4503-9d99-cf1b755bf2f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:37:15.394868 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65bc619-a986-4af9-920c-b8bf8c352e70 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 14:37:15.402761 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application [None req-c65bc619-a986-4af9-920c-b8bf8c352e70 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 26 14:37:15.402761 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:37:15.402761 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:37:15.402761 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:37:15.402761 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:37:15.402761 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:37:15.402761 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:37:15.402761 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:37:15.402761 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:37:15.402761 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:37:15.402761 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:37:15.402761 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:37:15.402761 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 14:37:15.402761 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 14:37:15.402761 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 14:37:15.402761 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 14:37:15.403870 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 14:37:15.403870 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 14:37:15.403870 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 14:37:15.403870 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 14:37:15.403870 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:37:15.403870 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:37:15.403870 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:37:15.403870 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:37:15.403870 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:37:15.403870 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:37:15.403870 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:37:15.403870 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application with Lock( Jul 26 14:37:15.403870 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:37:15.403870 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:37:15.403870 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:37:15.403870 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:37:15.404733 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:37:15.404733 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:37:15.404733 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:37:15.404733 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:37:15.404733 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 14:37:15.404733 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 14:37:15.404733 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 14:37:15.404733 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 14:37:15.404733 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 14:37:15.404733 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 14:37:15.404733 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 26 14:37:15.404733 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Jul 26 14:37:15.407266 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 33/67] 10.222.0.93 () {56 vars in 1099 bytes} [Tue Jul 26 14:37:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 14:37:15.408388 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65bc619-a986-4af9-920c-b8bf8c352e70 None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:37:15.470699 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:37:15.501051 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:37:15.530751 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 35/68] 10.222.0.93 () {58 vars in 1023 bytes} [Tue Jul 26 14:37:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 14:37:15.532957 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ee7d47-d883-4503-9d99-cf1b755bf2f5 None None] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:37:15.575439 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65bc619-a986-4af9-920c-b8bf8c352e70 None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:37:15.622478 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a2c516-9632-47f6-a48f-553e75bbb1e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:37:15.623366 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a2c516-9632-47f6-a48f-553e75bbb1e3 None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:15.623757 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a2c516-9632-47f6-a48f-553e75bbb1e3 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:15.624124 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a2c516-9632-47f6-a48f-553e75bbb1e3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:15.625555 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a2c516-9632-47f6-a48f-553e75bbb1e3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:37:15.627258 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a2c516-9632-47f6-a48f-553e75bbb1e3 None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:37:15.629107 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 34/69] 10.222.0.93 () {56 vars in 1108 bytes} [Tue Jul 26 14:37:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:37:15.630648 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc516bf-bf12-469c-9336-9a1c87d6dc07 None None] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:15.631081 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc516bf-bf12-469c-9336-9a1c87d6dc07 None None] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:15.631480 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc516bf-bf12-469c-9336-9a1c87d6dc07 None None] PATH_INFO: `/` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:15.633340 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 35/70] 10.222.0.93 () {54 vars in 926 bytes} [Tue Jul 26 14:37:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:37:15.633941 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc516bf-bf12-469c-9336-9a1c87d6dc07 None None] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:37:15.675768 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ee7d47-d883-4503-9d99-cf1b755bf2f5 None None] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:37:15.731410 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8551c646-c3ef-4486-9460-07138045988a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:37:15.732428 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8551c646-c3ef-4486-9460-07138045988a None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:15.732887 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8551c646-c3ef-4486-9460-07138045988a None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:15.733360 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8551c646-c3ef-4486-9460-07138045988a None admin] PATH_INFO: `/v3/roles` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:15.734651 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8551c646-c3ef-4486-9460-07138045988a None admin] RBAC: Adding query filter params (name=member) {{(pid=87056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:37:15.735137 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8551c646-c3ef-4486-9460-07138045988a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:37:15.737680 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8551c646-c3ef-4486-9460-07138045988a None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:37:15.753646 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 36/71] 10.222.0.93 () {56 vars in 1101 bytes} [Tue Jul 26 14:37:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:37:15.756194 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727c1eff-0d10-4b0d-8e7d-2804f2aad917 None None] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:15.756627 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727c1eff-0d10-4b0d-8e7d-2804f2aad917 None None] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:15.757037 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727c1eff-0d10-4b0d-8e7d-2804f2aad917 None None] PATH_INFO: `/` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:15.760115 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 37/72] 10.222.0.93 () {54 vars in 926 bytes} [Tue Jul 26 14:37:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:37:15.762314 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727c1eff-0d10-4b0d-8e7d-2804f2aad917 None None] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:37:15.776823 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc516bf-bf12-469c-9336-9a1c87d6dc07 None None] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:37:15.789427 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:37:15.829277 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5a3093-0486-428d-b4e0-a324be5a824a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:37:15.830413 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5a3093-0486-428d-b4e0-a324be5a824a None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:15.831229 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5a3093-0486-428d-b4e0-a324be5a824a None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:15.832056 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5a3093-0486-428d-b4e0-a324be5a824a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:15.838636 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:37:15.852281 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5a3093-0486-428d-b4e0-a324be5a824a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 14:37:15.863628 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application [None req-0f5a3093-0486-428d-b4e0-a324be5a824a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 14:37:15.863628 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:37:15.863628 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:37:15.863628 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:37:15.863628 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:37:15.863628 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:37:15.863628 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:37:15.863628 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:37:15.863628 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:37:15.863628 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:37:15.863628 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:37:15.863628 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:37:15.863628 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 14:37:15.863628 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 14:37:15.863628 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 14:37:15.863628 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 14:37:15.864856 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 14:37:15.864856 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 14:37:15.864856 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 14:37:15.864856 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 14:37:15.864856 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:37:15.864856 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:37:15.864856 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:37:15.864856 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:37:15.864856 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:37:15.864856 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:37:15.864856 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:37:15.864856 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application with Lock( Jul 26 14:37:15.864856 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:37:15.864856 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:37:15.864856 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:37:15.864856 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:37:15.866174 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:37:15.866174 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:37:15.866174 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:37:15.866174 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:37:15.866174 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 14:37:15.866174 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 14:37:15.866174 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 14:37:15.866174 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 14:37:15.866174 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 14:37:15.866174 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 14:37:15.866174 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 14:37:15.866174 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Jul 26 14:37:15.866174 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 36/73] 10.222.0.93 () {56 vars in 1114 bytes} [Tue Jul 26 14:37:15 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:37:15.868292 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2358c766-7747-43ca-b891-c9caabe0ad08 None None] REQUEST_METHOD: `POST` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:15.868840 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2358c766-7747-43ca-b891-c9caabe0ad08 None None] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:15.869350 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2358c766-7747-43ca-b891-c9caabe0ad08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:15.901024 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.auth.core [None req-2358c766-7747-43ca-b891-c9caabe0ad08 None None] MFA Rules not processed for user `e5ef88cc058f425b882bcb87a1e1e75c`. Rule list: `[]` (Enabled: `True`). {{(pid=87055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:37:15.903151 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.fernet_utils [None req-2358c766-7747-43ca-b891-c9caabe0ad08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:37:15.904571 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727c1eff-0d10-4b0d-8e7d-2804f2aad917 None None] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:37:15.951081 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b0d72d-5c06-4ec9-b5f7-7fcf22e08539 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:37:15.951883 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b0d72d-5c06-4ec9-b5f7-7fcf22e08539 None admin] REQUEST_METHOD: `POST` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:15.952000 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b0d72d-5c06-4ec9-b5f7-7fcf22e08539 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:15.952268 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b0d72d-5c06-4ec9-b5f7-7fcf22e08539 None admin] PATH_INFO: `/v3/users` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:15.952971 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b0d72d-5c06-4ec9-b5f7-7fcf22e08539 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:37:15.954513 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b0d72d-5c06-4ec9-b5f7-7fcf22e08539 None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:37:16.024785 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 37/74] 10.222.0.93 () {58 vars in 1023 bytes} [Tue Jul 26 14:37:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 14:37:16.024785 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2358c766-7747-43ca-b891-c9caabe0ad08 None None] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:37:16.056661 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 38/75] 10.222.0.93 () {60 vars in 1132 bytes} [Tue Jul 26 14:37:15 2022] POST /identity/v3/users => generated 289 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 14:37:16.058297 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01a28ec-5bf0-45ea-bab5-4b4dac13a8be None None] REQUEST_METHOD: `POST` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:16.058639 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01a28ec-5bf0-45ea-bab5-4b4dac13a8be None None] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:16.058925 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01a28ec-5bf0-45ea-bab5-4b4dac13a8be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:16.082406 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.auth.core [None req-c01a28ec-5bf0-45ea-bab5-4b4dac13a8be None None] MFA Rules not processed for user `e5ef88cc058f425b882bcb87a1e1e75c`. Rule list: `[]` (Enabled: `True`). {{(pid=87056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:37:16.083994 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.fernet_utils [None req-c01a28ec-5bf0-45ea-bab5-4b4dac13a8be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:37:16.185419 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 39/76] 10.222.0.93 () {58 vars in 1023 bytes} [Tue Jul 26 14:37:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 14:37:16.186612 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01a28ec-5bf0-45ea-bab5-4b4dac13a8be None None] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:37:16.222542 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:37:16.225842 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2358c766-7747-43ca-b891-c9caabe0ad08 None None] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:37:16.267027 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:37:16.292900 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43797f6-3fa0-46c7-8dbd-a8d149704056 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:37:16.293509 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43797f6-3fa0-46c7-8dbd-a8d149704056 None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:16.293793 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43797f6-3fa0-46c7-8dbd-a8d149704056 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:16.294073 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43797f6-3fa0-46c7-8dbd-a8d149704056 None admin] PATH_INFO: `/v3/users/7295436e2b73480da2d21e361333fbb8` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:16.317366 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43797f6-3fa0-46c7-8dbd-a8d149704056 None admin] RBAC: Authorizing `identity:get_user(user_id=7295436e2b73480da2d21e361333fbb8)` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:37:16.318947 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43797f6-3fa0-46c7-8dbd-a8d149704056 None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:37:16.321162 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 38/77] 10.222.0.93 () {56 vars in 1177 bytes} [Tue Jul 26 14:37:16 2022] GET /identity/v3/users/7295436e2b73480da2d21e361333fbb8 => generated 275 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:37:16.323439 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43797f6-3fa0-46c7-8dbd-a8d149704056 None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:37:16.395429 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01a28ec-5bf0-45ea-bab5-4b4dac13a8be None None] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:37:16.515479 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e85fb2-f012-40b1-af79-c68d48fc6cb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:37:16.516082 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e85fb2-f012-40b1-af79-c68d48fc6cb6 None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:16.516372 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e85fb2-f012-40b1-af79-c68d48fc6cb6 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:16.516658 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e85fb2-f012-40b1-af79-c68d48fc6cb6 None admin] PATH_INFO: `/v3/roles` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:16.517418 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e85fb2-f012-40b1-af79-c68d48fc6cb6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:37:16.517737 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e85fb2-f012-40b1-af79-c68d48fc6cb6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:37:16.519248 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e85fb2-f012-40b1-af79-c68d48fc6cb6 None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:37:16.530039 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 40/78] 10.222.0.93 () {56 vars in 1111 bytes} [Tue Jul 26 14:37:16 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 344 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:37:16.530996 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e85fb2-f012-40b1-af79-c68d48fc6cb6 None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:37:16.535633 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43797f6-3fa0-46c7-8dbd-a8d149704056 None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:37:16.584644 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e796e8-7cdf-4ff8-929d-bec82be13a86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:37:16.585420 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e796e8-7cdf-4ff8-929d-bec82be13a86 None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:16.585779 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e796e8-7cdf-4ff8-929d-bec82be13a86 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:16.586160 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e796e8-7cdf-4ff8-929d-bec82be13a86 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:16.599192 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e796e8-7cdf-4ff8-929d-bec82be13a86 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 14:37:16.605089 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application [None req-b9e796e8-7cdf-4ff8-929d-bec82be13a86 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 14:37:16.605089 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:37:16.605089 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:37:16.605089 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:37:16.605089 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:37:16.605089 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:37:16.605089 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:37:16.605089 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:37:16.605089 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:37:16.605089 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:37:16.605089 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:37:16.605089 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:37:16.605089 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 14:37:16.605089 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 14:37:16.605089 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 14:37:16.605089 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 14:37:16.605999 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 14:37:16.605999 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 14:37:16.605999 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 14:37:16.605999 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 14:37:16.605999 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:37:16.605999 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:37:16.605999 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:37:16.605999 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:37:16.605999 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:37:16.605999 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:37:16.605999 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:37:16.605999 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application with Lock( Jul 26 14:37:16.605999 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:37:16.605999 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:37:16.605999 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:37:16.605999 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:37:16.606794 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:37:16.606794 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:37:16.606794 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:37:16.606794 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:37:16.606794 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 14:37:16.606794 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 14:37:16.606794 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 14:37:16.606794 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 14:37:16.606794 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 14:37:16.606794 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 14:37:16.606794 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 14:37:16.606794 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Jul 26 14:37:16.606794 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 39/79] 10.222.0.93 () {56 vars in 1096 bytes} [Tue Jul 26 14:37:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:37:16.607465 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e796e8-7cdf-4ff8-929d-bec82be13a86 None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:37:16.642677 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:37:16.707165 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:37:16.714632 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e85fb2-f012-40b1-af79-c68d48fc6cb6 None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:37:16.770074 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdeb1acf-1a74-43a0-808e-25055e174a7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:37:16.770995 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdeb1acf-1a74-43a0-808e-25055e174a7b None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:16.771479 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdeb1acf-1a74-43a0-808e-25055e174a7b None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:16.771924 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdeb1acf-1a74-43a0-808e-25055e174a7b None admin] PATH_INFO: `/v3/roles/member` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:16.779548 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e796e8-7cdf-4ff8-929d-bec82be13a86 None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:37:16.785948 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdeb1acf-1a74-43a0-808e-25055e174a7b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 14:37:16.792977 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application [None req-cdeb1acf-1a74-43a0-808e-25055e174a7b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 26 14:37:16.792977 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:37:16.792977 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:37:16.792977 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:37:16.792977 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:37:16.792977 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:37:16.792977 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:37:16.792977 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:37:16.792977 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:37:16.792977 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:37:16.792977 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:37:16.792977 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:37:16.792977 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 14:37:16.792977 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 14:37:16.792977 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 14:37:16.792977 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 14:37:16.794073 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 14:37:16.794073 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 14:37:16.794073 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 14:37:16.794073 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 14:37:16.794073 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:37:16.794073 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:37:16.794073 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:37:16.794073 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:37:16.794073 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:37:16.794073 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:37:16.794073 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:37:16.794073 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application with Lock( Jul 26 14:37:16.794073 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:37:16.794073 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:37:16.794073 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:37:16.794073 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:37:16.794939 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:37:16.794939 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:37:16.794939 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:37:16.794939 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:37:16.794939 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 14:37:16.794939 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 14:37:16.794939 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 14:37:16.794939 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 14:37:16.794939 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 14:37:16.794939 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 14:37:16.794939 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 26 14:37:16.794939 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Jul 26 14:37:16.798792 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 41/80] 10.222.0.93 () {56 vars in 1099 bytes} [Tue Jul 26 14:37:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:37:16.800046 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdeb1acf-1a74-43a0-808e-25055e174a7b None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:37:16.836434 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f190c3-5dd3-4125-bc4c-20b9018a5234 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:37:16.837094 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f190c3-5dd3-4125-bc4c-20b9018a5234 None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:16.837511 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f190c3-5dd3-4125-bc4c-20b9018a5234 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:16.839074 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f190c3-5dd3-4125-bc4c-20b9018a5234 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:16.983116 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdeb1acf-1a74-43a0-808e-25055e174a7b None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:37:17.031296 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6c576d-8207-4916-864b-301163b6830d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:37:17.032813 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6c576d-8207-4916-864b-301163b6830d None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:17.033324 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6c576d-8207-4916-864b-301163b6830d None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:17.034482 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6c576d-8207-4916-864b-301163b6830d None admin] PATH_INFO: `/v3/users/7295436e2b73480da2d21e361333fbb8` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:17.036418 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6c576d-8207-4916-864b-301163b6830d None admin] RBAC: Authorizing `identity:get_user(user_id=7295436e2b73480da2d21e361333fbb8)` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:37:17.036873 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f190c3-5dd3-4125-bc4c-20b9018a5234 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:37:17.038642 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6c576d-8207-4916-864b-301163b6830d None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:37:17.038761 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f190c3-5dd3-4125-bc4c-20b9018a5234 None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:37:17.041646 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 42/81] 10.222.0.93 () {56 vars in 1177 bytes} [Tue Jul 26 14:37:16 2022] GET /identity/v3/users/7295436e2b73480da2d21e361333fbb8 => generated 275 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:37:17.042787 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6c576d-8207-4916-864b-301163b6830d None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:37:17.077109 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:37:17.081965 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:37:17.240957 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 40/82] 10.222.0.93 () {58 vars in 1282 bytes} [Tue Jul 26 14:37:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 634 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 14:37:17.244300 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f190c3-5dd3-4125-bc4c-20b9018a5234 None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:37:17.267201 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6c576d-8207-4916-864b-301163b6830d None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:37:17.331727 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04157c25-7dd1-4cbf-89c3-201c8789c0fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:37:17.332847 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04157c25-7dd1-4cbf-89c3-201c8789c0fc None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:17.332847 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04157c25-7dd1-4cbf-89c3-201c8789c0fc None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:17.333012 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04157c25-7dd1-4cbf-89c3-201c8789c0fc None admin] PATH_INFO: `/v3/roles` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:17.333722 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04157c25-7dd1-4cbf-89c3-201c8789c0fc None admin] RBAC: Adding query filter params (name=admin) {{(pid=87056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:37:17.334092 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04157c25-7dd1-4cbf-89c3-201c8789c0fc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:37:17.335674 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04157c25-7dd1-4cbf-89c3-201c8789c0fc None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:37:17.347352 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 43/83] 10.222.0.93 () {56 vars in 1099 bytes} [Tue Jul 26 14:37:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:37:17.349594 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04157c25-7dd1-4cbf-89c3-201c8789c0fc None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:37:17.405790 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f190c3-5dd3-4125-bc4c-20b9018a5234 None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:37:17.427741 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:37:17.451620 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef6c129-7e82-4f71-9a5f-07e9d2a70b64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:37:17.452284 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef6c129-7e82-4f71-9a5f-07e9d2a70b64 None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:17.452612 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef6c129-7e82-4f71-9a5f-07e9d2a70b64 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:17.452904 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef6c129-7e82-4f71-9a5f-07e9d2a70b64 None admin] PATH_INFO: `/v3/roles` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:17.454123 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef6c129-7e82-4f71-9a5f-07e9d2a70b64 None admin] RBAC: Adding query filter params (name=member) {{(pid=87055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:37:17.454123 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef6c129-7e82-4f71-9a5f-07e9d2a70b64 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:37:17.455661 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef6c129-7e82-4f71-9a5f-07e9d2a70b64 None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:37:17.467759 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 41/84] 10.222.0.93 () {56 vars in 1101 bytes} [Tue Jul 26 14:37:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:37:17.468682 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef6c129-7e82-4f71-9a5f-07e9d2a70b64 None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:37:17.479850 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:37:17.504686 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04157c25-7dd1-4cbf-89c3-201c8789c0fc None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:37:17.550223 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9885f6d-1f58-4600-a7c6-b6b5ddddeee2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:37:17.551389 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9885f6d-1f58-4600-a7c6-b6b5ddddeee2 None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:17.551891 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9885f6d-1f58-4600-a7c6-b6b5ddddeee2 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:17.552449 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9885f6d-1f58-4600-a7c6-b6b5ddddeee2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:17.601229 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef6c129-7e82-4f71-9a5f-07e9d2a70b64 None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:37:17.636823 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9885f6d-1f58-4600-a7c6-b6b5ddddeee2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:37:17.638939 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9885f6d-1f58-4600-a7c6-b6b5ddddeee2 None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:37:17.644564 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0f1144-5df3-451d-bc92-f4036ee0cdce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:37:17.645262 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0f1144-5df3-451d-bc92-f4036ee0cdce None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:17.645547 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0f1144-5df3-451d-bc92-f4036ee0cdce None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:17.645880 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0f1144-5df3-451d-bc92-f4036ee0cdce None admin] PATH_INFO: `/v3/projects/798795388b0c46a3a4ae48ca79f5c6ce` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:17.647405 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0f1144-5df3-451d-bc92-f4036ee0cdce None admin] RBAC: Authorizing `identity:get_project(project_id=798795388b0c46a3a4ae48ca79f5c6ce)` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:37:17.648968 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0f1144-5df3-451d-bc92-f4036ee0cdce None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:37:17.652510 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 42/85] 10.222.0.93 () {56 vars in 1186 bytes} [Tue Jul 26 14:37:17 2022] GET /identity/v3/projects/798795388b0c46a3a4ae48ca79f5c6ce => generated 298 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:37:17.653158 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0f1144-5df3-451d-bc92-f4036ee0cdce None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:37:17.717008 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:37:17.747499 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:37:17.768394 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 44/86] 10.222.0.93 () {58 vars in 1282 bytes} [Tue Jul 26 14:37:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 14:37:17.769747 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9885f6d-1f58-4600-a7c6-b6b5ddddeee2 None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:37:17.783087 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0f1144-5df3-451d-bc92-f4036ee0cdce None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:37:17.843990 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f303b38b-89ff-4bf8-b8ab-99812812c3e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:37:17.845385 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f303b38b-89ff-4bf8-b8ab-99812812c3e5 None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:17.846047 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f303b38b-89ff-4bf8-b8ab-99812812c3e5 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:17.847198 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f303b38b-89ff-4bf8-b8ab-99812812c3e5 None admin] PATH_INFO: `/v3/users/e5ef88cc058f425b882bcb87a1e1e75c` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:17.850184 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f303b38b-89ff-4bf8-b8ab-99812812c3e5 None admin] RBAC: Authorizing `identity:get_user(user_id=e5ef88cc058f425b882bcb87a1e1e75c)` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:37:17.855385 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f303b38b-89ff-4bf8-b8ab-99812812c3e5 None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:37:17.859635 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 43/87] 10.222.0.93 () {56 vars in 1177 bytes} [Tue Jul 26 14:37:17 2022] GET /identity/v3/users/e5ef88cc058f425b882bcb87a1e1e75c => generated 247 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:37:17.861601 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f303b38b-89ff-4bf8-b8ab-99812812c3e5 None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:37:17.978655 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9885f6d-1f58-4600-a7c6-b6b5ddddeee2 None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:37:18.051821 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e88ed8-e94e-4df6-9f1c-00c9ab763759 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:37:18.052888 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e88ed8-e94e-4df6-9f1c-00c9ab763759 None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:18.053199 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e88ed8-e94e-4df6-9f1c-00c9ab763759 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:18.054715 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e88ed8-e94e-4df6-9f1c-00c9ab763759 None admin] PATH_INFO: `/v3/users/7295436e2b73480da2d21e361333fbb8` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:18.056118 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e88ed8-e94e-4df6-9f1c-00c9ab763759 None admin] RBAC: Authorizing `identity:get_user(user_id=7295436e2b73480da2d21e361333fbb8)` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:37:18.058990 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e88ed8-e94e-4df6-9f1c-00c9ab763759 None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:37:18.063003 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 45/88] 10.222.0.93 () {56 vars in 1177 bytes} [Tue Jul 26 14:37:17 2022] GET /identity/v3/users/7295436e2b73480da2d21e361333fbb8 => generated 275 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:37:18.064162 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e88ed8-e94e-4df6-9f1c-00c9ab763759 None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:37:18.079899 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f303b38b-89ff-4bf8-b8ab-99812812c3e5 None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:37:18.114554 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:37:18.147525 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389d6724-180b-4360-a55b-3a42518c3ab1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:37:18.148877 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389d6724-180b-4360-a55b-3a42518c3ab1 None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:18.149614 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389d6724-180b-4360-a55b-3a42518c3ab1 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:18.150962 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389d6724-180b-4360-a55b-3a42518c3ab1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:18.152701 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389d6724-180b-4360-a55b-3a42518c3ab1 None admin] RBAC: Adding query filter params (role.id=8b8a4a451dc84c17bba824b2ff9cc4fe, scope.project.id=798795388b0c46a3a4ae48ca79f5c6ce, user.id=7295436e2b73480da2d21e361333fbb8) {{(pid=87055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:37:18.153430 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389d6724-180b-4360-a55b-3a42518c3ab1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:37:18.156262 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389d6724-180b-4360-a55b-3a42518c3ab1 None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:37:18.168778 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 44/89] 10.222.0.93 () {56 vars in 1374 bytes} [Tue Jul 26 14:37:17 2022] GET /identity/v3/role_assignments?user.id=7295436e2b73480da2d21e361333fbb8&scope.project.id=798795388b0c46a3a4ae48ca79f5c6ce&role.id=8b8a4a451dc84c17bba824b2ff9cc4fe => generated 259 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:37:18.171065 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389d6724-180b-4360-a55b-3a42518c3ab1 None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:37:18.176792 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:37:18.266755 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e88ed8-e94e-4df6-9f1c-00c9ab763759 None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:37:18.334645 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d793f960-e28e-42e6-b23a-849950deda00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:37:18.335929 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d793f960-e28e-42e6-b23a-849950deda00 None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:18.336182 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d793f960-e28e-42e6-b23a-849950deda00 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:18.336650 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d793f960-e28e-42e6-b23a-849950deda00 None admin] PATH_INFO: `/v3/projects/798795388b0c46a3a4ae48ca79f5c6ce` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:18.340244 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d793f960-e28e-42e6-b23a-849950deda00 None admin] RBAC: Authorizing `identity:get_project(project_id=798795388b0c46a3a4ae48ca79f5c6ce)` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:37:18.342829 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d793f960-e28e-42e6-b23a-849950deda00 None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:37:18.346309 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 46/90] 10.222.0.93 () {56 vars in 1186 bytes} [Tue Jul 26 14:37:18 2022] GET /identity/v3/projects/798795388b0c46a3a4ae48ca79f5c6ce => generated 298 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:37:18.347727 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d793f960-e28e-42e6-b23a-849950deda00 None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:37:18.419207 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389d6724-180b-4360-a55b-3a42518c3ab1 None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:37:18.515189 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d793f960-e28e-42e6-b23a-849950deda00 None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:37:18.517698 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef4d26e-9cfa-4397-9c43-f8934b711f9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:37:18.518489 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef4d26e-9cfa-4397-9c43-f8934b711f9c None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:18.518807 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef4d26e-9cfa-4397-9c43-f8934b711f9c None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:18.519097 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef4d26e-9cfa-4397-9c43-f8934b711f9c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:18.544707 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:37:18.559463 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a166c01f-4c01-4021-83b1-cb9df8610ee0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:37:18.560226 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a166c01f-4c01-4021-83b1-cb9df8610ee0 None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:18.560509 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a166c01f-4c01-4021-83b1-cb9df8610ee0 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:18.560783 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a166c01f-4c01-4021-83b1-cb9df8610ee0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:18.612829 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:37:18.653196 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef4d26e-9cfa-4397-9c43-f8934b711f9c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:37:18.656536 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef4d26e-9cfa-4397-9c43-f8934b711f9c None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:37:18.663618 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a166c01f-4c01-4021-83b1-cb9df8610ee0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:37:18.664931 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a166c01f-4c01-4021-83b1-cb9df8610ee0 None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:37:18.799861 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 47/91] 10.222.0.93 () {58 vars in 1282 bytes} [Tue Jul 26 14:37:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 453 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 14:37:18.801353 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a166c01f-4c01-4021-83b1-cb9df8610ee0 None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:37:18.858672 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:37:18.864178 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 45/92] 10.222.0.93 () {58 vars in 1282 bytes} [Tue Jul 26 14:37:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 694 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 14:37:18.865751 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef4d26e-9cfa-4397-9c43-f8934b711f9c None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:37:19.044439 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:37:19.068464 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef4d26e-9cfa-4397-9c43-f8934b711f9c None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:37:19.099386 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a166c01f-4c01-4021-83b1-cb9df8610ee0 None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:37:19.133864 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871d3399-ab95-467d-ad85-ab005aa41743 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:37:19.135337 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871d3399-ab95-467d-ad85-ab005aa41743 None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:19.135900 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871d3399-ab95-467d-ad85-ab005aa41743 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:19.141317 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871d3399-ab95-467d-ad85-ab005aa41743 None admin] PATH_INFO: `/v3/projects/507ce424ca774469b12dd7bbc4b4c17e` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:19.141317 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871d3399-ab95-467d-ad85-ab005aa41743 None admin] RBAC: Authorizing `identity:get_project(project_id=507ce424ca774469b12dd7bbc4b4c17e)` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:37:19.141317 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871d3399-ab95-467d-ad85-ab005aa41743 None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:37:19.141317 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 46/93] 10.222.0.93 () {56 vars in 1186 bytes} [Tue Jul 26 14:37:18 2022] GET /identity/v3/projects/507ce424ca774469b12dd7bbc4b4c17e => generated 312 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:37:19.142055 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871d3399-ab95-467d-ad85-ab005aa41743 None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:37:19.177914 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da7eae0-4ec7-4871-b279-fcb42f7544e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:37:19.179252 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da7eae0-4ec7-4871-b279-fcb42f7544e7 None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:19.180235 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da7eae0-4ec7-4871-b279-fcb42f7544e7 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:19.181114 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da7eae0-4ec7-4871-b279-fcb42f7544e7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:19.183106 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da7eae0-4ec7-4871-b279-fcb42f7544e7 None admin] RBAC: Adding query filter params (role.id=ef1a806f8d774452a6536b57a4670ceb, scope.project.id=798795388b0c46a3a4ae48ca79f5c6ce, user.id=7295436e2b73480da2d21e361333fbb8) {{(pid=87056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:37:19.183912 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da7eae0-4ec7-4871-b279-fcb42f7544e7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:37:19.188141 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da7eae0-4ec7-4871-b279-fcb42f7544e7 None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:37:19.210280 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 48/94] 10.222.0.93 () {56 vars in 1374 bytes} [Tue Jul 26 14:37:18 2022] GET /identity/v3/role_assignments?user.id=7295436e2b73480da2d21e361333fbb8&scope.project.id=798795388b0c46a3a4ae48ca79f5c6ce&role.id=ef1a806f8d774452a6536b57a4670ceb => generated 259 bytes in 402 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:37:19.210280 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e712b231-b6d3-4636-b14e-fcee9df840cf None None] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:19.210280 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e712b231-b6d3-4636-b14e-fcee9df840cf None None] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:19.210280 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e712b231-b6d3-4636-b14e-fcee9df840cf None None] PATH_INFO: `/` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:19.210280 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 49/95] 10.222.0.93 () {54 vars in 926 bytes} [Tue Jul 26 14:37:19 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:37:19.210280 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e712b231-b6d3-4636-b14e-fcee9df840cf None None] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:37:19.289889 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871d3399-ab95-467d-ad85-ab005aa41743 None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:37:19.345563 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26adc25-d4c4-43f3-a57c-4282437bf43b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:37:19.346162 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26adc25-d4c4-43f3-a57c-4282437bf43b None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:19.346605 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26adc25-d4c4-43f3-a57c-4282437bf43b None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:19.346961 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26adc25-d4c4-43f3-a57c-4282437bf43b None admin] PATH_INFO: `/v3/projects/798795388b0c46a3a4ae48ca79f5c6ce` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:19.348371 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26adc25-d4c4-43f3-a57c-4282437bf43b None admin] RBAC: Authorizing `identity:get_project(project_id=798795388b0c46a3a4ae48ca79f5c6ce)` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:37:19.350063 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26adc25-d4c4-43f3-a57c-4282437bf43b None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:37:19.358607 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 47/96] 10.222.0.93 () {56 vars in 1186 bytes} [Tue Jul 26 14:37:19 2022] GET /identity/v3/projects/798795388b0c46a3a4ae48ca79f5c6ce => generated 298 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:37:19.360208 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fb9af1-7474-4079-8a2c-0e2133cbcb93 None None] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:19.360490 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fb9af1-7474-4079-8a2c-0e2133cbcb93 None None] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:19.360840 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fb9af1-7474-4079-8a2c-0e2133cbcb93 None None] PATH_INFO: `/` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:19.364595 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 48/97] 10.222.0.93 () {54 vars in 926 bytes} [Tue Jul 26 14:37:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:37:19.372540 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91938ea4-39f2-4cb8-82b1-a043623d5d49 None None] REQUEST_METHOD: `POST` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:19.372843 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91938ea4-39f2-4cb8-82b1-a043623d5d49 None None] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:19.373112 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91938ea4-39f2-4cb8-82b1-a043623d5d49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:19.381318 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:37:19.402623 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e712b231-b6d3-4636-b14e-fcee9df840cf None None] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:37:19.405118 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.auth.core [None req-91938ea4-39f2-4cb8-82b1-a043623d5d49 None None] MFA Rules not processed for user `e5ef88cc058f425b882bcb87a1e1e75c`. Rule list: `[]` (Enabled: `True`). {{(pid=87055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:37:19.408853 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.fernet_utils [None req-91938ea4-39f2-4cb8-82b1-a043623d5d49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:37:19.510460 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:37:19.584128 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6a3dd9-4efa-44bc-83e0-1466b602e64e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:37:19.585668 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6a3dd9-4efa-44bc-83e0-1466b602e64e None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:19.587965 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6a3dd9-4efa-44bc-83e0-1466b602e64e None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:19.588818 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6a3dd9-4efa-44bc-83e0-1466b602e64e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:19.591428 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6a3dd9-4efa-44bc-83e0-1466b602e64e None admin] RBAC: Adding query filter params (role.id=8b8a4a451dc84c17bba824b2ff9cc4fe, scope.project.id=507ce424ca774469b12dd7bbc4b4c17e, user.id=7295436e2b73480da2d21e361333fbb8) {{(pid=87056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:37:19.592307 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6a3dd9-4efa-44bc-83e0-1466b602e64e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:37:19.597426 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6a3dd9-4efa-44bc-83e0-1466b602e64e None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:37:19.611444 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 49/98] 10.222.0.93 () {58 vars in 1023 bytes} [Tue Jul 26 14:37:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 14:37:19.612416 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91938ea4-39f2-4cb8-82b1-a043623d5d49 None None] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:37:19.615259 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 50/99] 10.222.0.93 () {56 vars in 1374 bytes} [Tue Jul 26 14:37:19 2022] GET /identity/v3/role_assignments?user.id=7295436e2b73480da2d21e361333fbb8&scope.project.id=507ce424ca774469b12dd7bbc4b4c17e&role.id=8b8a4a451dc84c17bba824b2ff9cc4fe => generated 259 bytes in 406 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:37:19.619685 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d30168-f666-476c-b878-1d2a23083f72 None None] REQUEST_METHOD: `POST` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:19.620612 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d30168-f666-476c-b878-1d2a23083f72 None None] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:19.621405 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d30168-f666-476c-b878-1d2a23083f72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:19.665205 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.auth.core [None req-20d30168-f666-476c-b878-1d2a23083f72 None None] MFA Rules not processed for user `e5ef88cc058f425b882bcb87a1e1e75c`. Rule list: `[]` (Enabled: `True`). {{(pid=87056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:37:19.669571 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.fernet_utils [None req-20d30168-f666-476c-b878-1d2a23083f72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:37:19.829174 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 51/100] 10.222.0.93 () {58 vars in 1023 bytes} [Tue Jul 26 14:37:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 14:37:19.831772 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d30168-f666-476c-b878-1d2a23083f72 None None] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:37:19.841535 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91938ea4-39f2-4cb8-82b1-a043623d5d49 None None] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:37:19.919033 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80eea0d3-36b2-4a0c-af4a-56e40a8483fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:37:19.920643 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eea0d3-36b2-4a0c-af4a-56e40a8483fb None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:19.921496 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eea0d3-36b2-4a0c-af4a-56e40a8483fb None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:19.922274 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eea0d3-36b2-4a0c-af4a-56e40a8483fb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:19.924526 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80eea0d3-36b2-4a0c-af4a-56e40a8483fb None admin] RBAC: Adding query filter params (role.id=94e105ff8ee4486abd501415cc05ba38, scope.project.id=798795388b0c46a3a4ae48ca79f5c6ce, user.id=e5ef88cc058f425b882bcb87a1e1e75c) {{(pid=87055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:37:19.925498 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80eea0d3-36b2-4a0c-af4a-56e40a8483fb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:37:19.928742 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80eea0d3-36b2-4a0c-af4a-56e40a8483fb None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:37:19.941608 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 50/101] 10.222.0.93 () {56 vars in 1374 bytes} [Tue Jul 26 14:37:19 2022] GET /identity/v3/role_assignments?user.id=e5ef88cc058f425b882bcb87a1e1e75c&scope.project.id=798795388b0c46a3a4ae48ca79f5c6ce&role.id=94e105ff8ee4486abd501415cc05ba38 => generated 259 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:37:19.956139 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80eea0d3-36b2-4a0c-af4a-56e40a8483fb None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:37:19.984372 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:37:20.108700 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:37:20.168810 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d30168-f666-476c-b878-1d2a23083f72 None None] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:37:20.180842 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80eea0d3-36b2-4a0c-af4a-56e40a8483fb None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:37:20.275757 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f08906-fa95-4e5a-ab69-27d6878e5ca1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:37:20.276463 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f08906-fa95-4e5a-ab69-27d6878e5ca1 None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:20.276760 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f08906-fa95-4e5a-ab69-27d6878e5ca1 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:20.277088 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f08906-fa95-4e5a-ab69-27d6878e5ca1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:20.283292 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f08906-fa95-4e5a-ab69-27d6878e5ca1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:37:20.284825 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f08906-fa95-4e5a-ab69-27d6878e5ca1 None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:37:20.286940 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 51/102] 10.222.0.93 () {56 vars in 1108 bytes} [Tue Jul 26 14:37:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:37:20.296472 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d1aa36-e682-4612-bd7c-2a8a94697d80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:37:20.297161 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f08906-fa95-4e5a-ab69-27d6878e5ca1 None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:37:20.297751 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d1aa36-e682-4612-bd7c-2a8a94697d80 None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:20.298415 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d1aa36-e682-4612-bd7c-2a8a94697d80 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:20.298941 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d1aa36-e682-4612-bd7c-2a8a94697d80 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:20.325576 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d1aa36-e682-4612-bd7c-2a8a94697d80 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 14:37:20.336250 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application [None req-53d1aa36-e682-4612-bd7c-2a8a94697d80 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 26 14:37:20.336250 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:37:20.336250 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:37:20.336250 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:37:20.336250 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:37:20.336250 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:37:20.336250 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:37:20.336250 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:37:20.336250 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:37:20.336250 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:37:20.336250 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:37:20.336250 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:37:20.336250 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 14:37:20.336250 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 14:37:20.336250 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 14:37:20.336250 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 14:37:20.338519 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 14:37:20.338519 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 14:37:20.338519 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 14:37:20.338519 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 14:37:20.338519 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:37:20.338519 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:37:20.338519 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:37:20.338519 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:37:20.338519 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:37:20.338519 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:37:20.338519 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:37:20.338519 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application with Lock( Jul 26 14:37:20.338519 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:37:20.338519 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:37:20.338519 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:37:20.338519 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:37:20.340828 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:37:20.340828 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:37:20.340828 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:37:20.340828 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:37:20.340828 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 14:37:20.340828 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 14:37:20.340828 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 14:37:20.340828 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 14:37:20.340828 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 14:37:20.340828 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 14:37:20.340828 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 26 14:37:20.340828 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Jul 26 14:37:20.340828 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 52/103] 10.222.0.93 () {56 vars in 1099 bytes} [Tue Jul 26 14:37:19 2022] GET /identity/v3/roles/reader => generated 84 bytes in 510 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:37:20.352291 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d1aa36-e682-4612-bd7c-2a8a94697d80 None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:37:20.606869 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:37:20.687540 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f08906-fa95-4e5a-ab69-27d6878e5ca1 None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:37:20.758590 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d1aa36-e682-4612-bd7c-2a8a94697d80 None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:37:20.811722 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006c77a3-42f8-4df2-9bed-521620230fd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:37:20.812424 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006c77a3-42f8-4df2-9bed-521620230fd8 None admin] REQUEST_METHOD: `POST` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:20.812716 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006c77a3-42f8-4df2-9bed-521620230fd8 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:20.813000 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006c77a3-42f8-4df2-9bed-521620230fd8 None admin] PATH_INFO: `/v3/projects` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:20.813714 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006c77a3-42f8-4df2-9bed-521620230fd8 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:37:20.819461 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006c77a3-42f8-4df2-9bed-521620230fd8 None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:37:20.847551 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db68fa35-ee02-43a0-b7bd-e67027629c0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:37:20.848692 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db68fa35-ee02-43a0-b7bd-e67027629c0b None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:20.849207 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db68fa35-ee02-43a0-b7bd-e67027629c0b None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:20.849711 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db68fa35-ee02-43a0-b7bd-e67027629c0b None admin] PATH_INFO: `/v3/roles` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:20.851334 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db68fa35-ee02-43a0-b7bd-e67027629c0b None admin] RBAC: Adding query filter params (name=reader) {{(pid=87056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:37:20.851911 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db68fa35-ee02-43a0-b7bd-e67027629c0b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:37:20.855358 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db68fa35-ee02-43a0-b7bd-e67027629c0b None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:37:20.880653 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 53/104] 10.222.0.93 () {56 vars in 1101 bytes} [Tue Jul 26 14:37:20 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 529 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:37:20.888792 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db68fa35-ee02-43a0-b7bd-e67027629c0b None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:37:20.895749 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:37:20.985290 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 52/105] 10.222.0.93 () {60 vars in 1141 bytes} [Tue Jul 26 14:37:20 2022] POST /identity/v3/projects => generated 302 bytes in 689 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 14:37:21.113454 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db68fa35-ee02-43a0-b7bd-e67027629c0b None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:37:21.176972 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f8210d-53c4-47c1-ba96-10d6cdf678a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:37:21.177665 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f8210d-53c4-47c1-ba96-10d6cdf678a1 None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:21.177948 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f8210d-53c4-47c1-ba96-10d6cdf678a1 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:21.178223 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f8210d-53c4-47c1-ba96-10d6cdf678a1 None admin] PATH_INFO: `/v3/users/13cbdb2b220f42cd8737957639a98fe6` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:21.206821 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f8210d-53c4-47c1-ba96-10d6cdf678a1 None admin] RBAC: Authorizing `identity:get_user(user_id=13cbdb2b220f42cd8737957639a98fe6)` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:37:21.208428 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f8210d-53c4-47c1-ba96-10d6cdf678a1 None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:37:21.210291 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 54/106] 10.222.0.93 () {56 vars in 1177 bytes} [Tue Jul 26 14:37:20 2022] GET /identity/v3/users/13cbdb2b220f42cd8737957639a98fe6 => generated 289 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:37:21.217445 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006c77a3-42f8-4df2-9bed-521620230fd8 None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:37:21.479920 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006c77a3-42f8-4df2-9bed-521620230fd8 None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:37:21.486397 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d0fd3f-f6cc-4c7a-b83f-235a0c7250f9 None None] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:21.486719 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d0fd3f-f6cc-4c7a-b83f-235a0c7250f9 None None] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:21.486961 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d0fd3f-f6cc-4c7a-b83f-235a0c7250f9 None None] PATH_INFO: `/` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:21.488743 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 55/107] 10.222.0.93 () {54 vars in 926 bytes} [Tue Jul 26 14:37:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:37:21.518846 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a011bf3f-a82f-4975-9b93-161e89c0ac86 None None] REQUEST_METHOD: `POST` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:21.519341 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a011bf3f-a82f-4975-9b93-161e89c0ac86 None None] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:21.519832 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a011bf3f-a82f-4975-9b93-161e89c0ac86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:21.553140 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:37:21.562736 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.auth.core [None req-a011bf3f-a82f-4975-9b93-161e89c0ac86 None None] MFA Rules not processed for user `e5ef88cc058f425b882bcb87a1e1e75c`. Rule list: `[]` (Enabled: `True`). {{(pid=87056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:37:21.563969 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.fernet_utils [None req-a011bf3f-a82f-4975-9b93-161e89c0ac86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:37:21.564679 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c4760b-ad2f-460e-b3c6-e2dc19503541 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:37:21.566169 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c4760b-ad2f-460e-b3c6-e2dc19503541 None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:21.585017 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c4760b-ad2f-460e-b3c6-e2dc19503541 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:21.585017 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c4760b-ad2f-460e-b3c6-e2dc19503541 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:21.749208 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:37:21.794548 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 56/108] 10.222.0.93 () {58 vars in 1023 bytes} [Tue Jul 26 14:37:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 14:37:21.812226 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c4760b-ad2f-460e-b3c6-e2dc19503541 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:37:21.815117 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c4760b-ad2f-460e-b3c6-e2dc19503541 None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:37:21.826518 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a011bf3f-a82f-4975-9b93-161e89c0ac86 None None] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:37:22.059486 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 53/109] 10.222.0.93 () {58 vars in 1282 bytes} [Tue Jul 26 14:37:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 843 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 14:37:22.067377 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c4760b-ad2f-460e-b3c6-e2dc19503541 None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:37:22.120919 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:37:22.137372 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a011bf3f-a82f-4975-9b93-161e89c0ac86 None None] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:37:22.244344 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae67a31f-6486-4499-8b0b-ec6e180439d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:37:22.245659 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae67a31f-6486-4499-8b0b-ec6e180439d6 None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:22.246120 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae67a31f-6486-4499-8b0b-ec6e180439d6 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:22.249259 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae67a31f-6486-4499-8b0b-ec6e180439d6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:22.287936 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae67a31f-6486-4499-8b0b-ec6e180439d6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 14:37:22.298278 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application [None req-ae67a31f-6486-4499-8b0b-ec6e180439d6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 26 14:37:22.298278 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:37:22.298278 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:37:22.298278 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:37:22.298278 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:37:22.298278 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:37:22.298278 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:37:22.298278 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:37:22.298278 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:37:22.298278 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:37:22.298278 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:37:22.298278 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:37:22.298278 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 14:37:22.298278 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 14:37:22.298278 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 14:37:22.298278 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 14:37:22.299195 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 14:37:22.299195 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 14:37:22.299195 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 14:37:22.299195 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 14:37:22.299195 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:37:22.299195 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:37:22.299195 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:37:22.299195 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:37:22.299195 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:37:22.299195 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:37:22.299195 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:37:22.299195 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application with Lock( Jul 26 14:37:22.299195 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:37:22.299195 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:37:22.299195 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:37:22.299195 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:37:22.299971 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:37:22.299971 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:37:22.299971 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:37:22.299971 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:37:22.299971 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 14:37:22.299971 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 14:37:22.299971 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 14:37:22.299971 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 14:37:22.299971 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 14:37:22.299971 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 14:37:22.299971 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 26 14:37:22.299971 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Jul 26 14:37:22.300586 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 57/110] 10.222.0.93 () {56 vars in 1099 bytes} [Tue Jul 26 14:37:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 475 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 14:37:22.311688 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae67a31f-6486-4499-8b0b-ec6e180439d6 None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:37:22.320267 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c4760b-ad2f-460e-b3c6-e2dc19503541 None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:37:22.405993 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52aef345-7536-4243-bab1-c84cf47c583e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:37:22.407322 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52aef345-7536-4243-bab1-c84cf47c583e None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:22.407811 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52aef345-7536-4243-bab1-c84cf47c583e None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:22.408283 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52aef345-7536-4243-bab1-c84cf47c583e None admin] PATH_INFO: `/v3/projects/798795388b0c46a3a4ae48ca79f5c6ce` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:22.415175 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52aef345-7536-4243-bab1-c84cf47c583e None admin] RBAC: Authorizing `identity:get_project(project_id=798795388b0c46a3a4ae48ca79f5c6ce)` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:37:22.417235 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52aef345-7536-4243-bab1-c84cf47c583e None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:37:22.417698 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:37:22.419458 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 54/111] 10.222.0.93 () {56 vars in 1186 bytes} [Tue Jul 26 14:37:22 2022] GET /identity/v3/projects/798795388b0c46a3a4ae48ca79f5c6ce => generated 298 bytes in 353 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:37:22.425577 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52aef345-7536-4243-bab1-c84cf47c583e None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:37:22.524828 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae67a31f-6486-4499-8b0b-ec6e180439d6 None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:37:22.604783 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c02606c-f2bc-401c-bc2b-8ba195909280 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:37:22.605497 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c02606c-f2bc-401c-bc2b-8ba195909280 None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:22.605806 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c02606c-f2bc-401c-bc2b-8ba195909280 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:22.606068 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c02606c-f2bc-401c-bc2b-8ba195909280 None admin] PATH_INFO: `/v3/roles` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:22.606863 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c02606c-f2bc-401c-bc2b-8ba195909280 None admin] RBAC: Adding query filter params (name=member) {{(pid=87056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:37:22.607169 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c02606c-f2bc-401c-bc2b-8ba195909280 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:37:22.608625 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c02606c-f2bc-401c-bc2b-8ba195909280 None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:37:22.639490 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 58/112] 10.222.0.93 () {56 vars in 1101 bytes} [Tue Jul 26 14:37:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:37:22.648244 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c02606c-f2bc-401c-bc2b-8ba195909280 None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:37:22.708926 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:37:22.717784 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52aef345-7536-4243-bab1-c84cf47c583e None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:37:22.808649 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d281c7ea-6766-4892-81e2-d3c513a76796 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:37:22.810221 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d281c7ea-6766-4892-81e2-d3c513a76796 None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:22.811087 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d281c7ea-6766-4892-81e2-d3c513a76796 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:22.811884 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d281c7ea-6766-4892-81e2-d3c513a76796 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:22.813706 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d281c7ea-6766-4892-81e2-d3c513a76796 None admin] RBAC: Adding query filter params (role.id=8b206d8d963645f6bd492384b6c5d39f, scope.project.id=798795388b0c46a3a4ae48ca79f5c6ce, user.id=13cbdb2b220f42cd8737957639a98fe6) {{(pid=87055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:37:22.814927 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d281c7ea-6766-4892-81e2-d3c513a76796 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:37:22.818429 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d281c7ea-6766-4892-81e2-d3c513a76796 None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:37:22.832899 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 55/113] 10.222.0.93 () {56 vars in 1374 bytes} [Tue Jul 26 14:37:22 2022] GET /identity/v3/role_assignments?user.id=13cbdb2b220f42cd8737957639a98fe6&scope.project.id=798795388b0c46a3a4ae48ca79f5c6ce&role.id=8b206d8d963645f6bd492384b6c5d39f => generated 259 bytes in 408 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:37:22.835921 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bf16ce-f114-4c53-8cfc-25e841c8eef8 None None] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:22.836816 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bf16ce-f114-4c53-8cfc-25e841c8eef8 None None] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:22.837738 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bf16ce-f114-4c53-8cfc-25e841c8eef8 None None] PATH_INFO: `/` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:22.840903 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 56/114] 10.222.0.93 () {54 vars in 926 bytes} [Tue Jul 26 14:37:22 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:37:22.846886 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4360a980-15e5-4800-92ea-e20662b86b22 None None] REQUEST_METHOD: `POST` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:22.847263 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4360a980-15e5-4800-92ea-e20662b86b22 None None] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:22.847439 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4360a980-15e5-4800-92ea-e20662b86b22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:22.882949 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.auth.core [None req-4360a980-15e5-4800-92ea-e20662b86b22 None None] MFA Rules not processed for user `e5ef88cc058f425b882bcb87a1e1e75c`. Rule list: `[]` (Enabled: `True`). {{(pid=87055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:37:22.884141 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.fernet_utils [None req-4360a980-15e5-4800-92ea-e20662b86b22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:37:22.917922 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c02606c-f2bc-401c-bc2b-8ba195909280 None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:37:22.944880 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:37:22.999198 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bdf785-d576-4b74-a711-feaf1991fea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:37:23.001120 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bdf785-d576-4b74-a711-feaf1991fea5 None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:23.001847 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bdf785-d576-4b74-a711-feaf1991fea5 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:23.008354 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bdf785-d576-4b74-a711-feaf1991fea5 None admin] PATH_INFO: `/v3/users/7295436e2b73480da2d21e361333fbb8` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:23.011780 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bdf785-d576-4b74-a711-feaf1991fea5 None admin] RBAC: Authorizing `identity:get_user(user_id=7295436e2b73480da2d21e361333fbb8)` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:37:23.019378 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bdf785-d576-4b74-a711-feaf1991fea5 None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:37:23.023135 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 59/115] 10.222.0.93 () {56 vars in 1177 bytes} [Tue Jul 26 14:37:22 2022] GET /identity/v3/users/7295436e2b73480da2d21e361333fbb8 => generated 275 bytes in 375 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:37:23.034693 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bdf785-d576-4b74-a711-feaf1991fea5 None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:37:23.109344 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 57/116] 10.222.0.93 () {58 vars in 1023 bytes} [Tue Jul 26 14:37:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 14:37:23.151973 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4360a980-15e5-4800-92ea-e20662b86b22 None None] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:37:23.301795 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bdf785-d576-4b74-a711-feaf1991fea5 None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:37:23.349640 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765f3471-7892-4a30-a9ab-a454aedf4b3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:37:23.350594 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765f3471-7892-4a30-a9ab-a454aedf4b3e None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:23.351022 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765f3471-7892-4a30-a9ab-a454aedf4b3e None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:23.351443 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765f3471-7892-4a30-a9ab-a454aedf4b3e None admin] PATH_INFO: `/v3/projects/798795388b0c46a3a4ae48ca79f5c6ce` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:23.359261 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765f3471-7892-4a30-a9ab-a454aedf4b3e None admin] RBAC: Authorizing `identity:get_project(project_id=798795388b0c46a3a4ae48ca79f5c6ce)` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:37:23.361099 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765f3471-7892-4a30-a9ab-a454aedf4b3e None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:37:23.363438 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 60/117] 10.222.0.93 () {56 vars in 1186 bytes} [Tue Jul 26 14:37:23 2022] GET /identity/v3/projects/798795388b0c46a3a4ae48ca79f5c6ce => generated 298 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:37:23.371746 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765f3471-7892-4a30-a9ab-a454aedf4b3e None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:37:23.439651 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:37:23.441687 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:37:23.464613 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4360a980-15e5-4800-92ea-e20662b86b22 None None] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:37:23.500360 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765f3471-7892-4a30-a9ab-a454aedf4b3e None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:37:23.545722 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a77cdd-6ec6-4859-bfa8-96d41e9bbe41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:37:23.547028 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a77cdd-6ec6-4859-bfa8-96d41e9bbe41 None admin] REQUEST_METHOD: `PUT` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:23.548760 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a77cdd-6ec6-4859-bfa8-96d41e9bbe41 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:23.549215 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a77cdd-6ec6-4859-bfa8-96d41e9bbe41 None admin] PATH_INFO: `/v3/projects/798795388b0c46a3a4ae48ca79f5c6ce/users/7295436e2b73480da2d21e361333fbb8/roles/8b8a4a451dc84c17bba824b2ff9cc4fe` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:23.554425 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a77cdd-6ec6-4859-bfa8-96d41e9bbe41 None admin] RBAC: Authorizing `identity:create_grant(project_id=798795388b0c46a3a4ae48ca79f5c6ce, user_id=7295436e2b73480da2d21e361333fbb8, role_id=8b8a4a451dc84c17bba824b2ff9cc4fe)` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:37:23.557386 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a77cdd-6ec6-4859-bfa8-96d41e9bbe41 None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:37:23.564492 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f9dde6-ff1b-4105-9c76-ec4372885cc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:37:23.565441 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f9dde6-ff1b-4105-9c76-ec4372885cc9 None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:23.565869 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f9dde6-ff1b-4105-9c76-ec4372885cc9 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:23.566313 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f9dde6-ff1b-4105-9c76-ec4372885cc9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:23.590895 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f9dde6-ff1b-4105-9c76-ec4372885cc9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 14:37:23.596527 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application [None req-e2f9dde6-ff1b-4105-9c76-ec4372885cc9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 14:37:23.596527 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:37:23.596527 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:37:23.596527 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:37:23.596527 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:37:23.596527 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:37:23.596527 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:37:23.596527 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:37:23.596527 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:37:23.596527 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:37:23.596527 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:37:23.596527 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:37:23.596527 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 14:37:23.596527 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 14:37:23.596527 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 14:37:23.596527 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 14:37:23.597780 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 14:37:23.597780 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 14:37:23.597780 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 14:37:23.597780 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 14:37:23.597780 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:37:23.597780 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:37:23.597780 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:37:23.597780 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:37:23.597780 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:37:23.597780 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:37:23.597780 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:37:23.597780 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application with Lock( Jul 26 14:37:23.597780 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:37:23.597780 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:37:23.597780 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:37:23.597780 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:37:23.598741 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:37:23.598741 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:37:23.598741 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:37:23.598741 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:37:23.598741 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 14:37:23.598741 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 14:37:23.598741 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 14:37:23.598741 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 14:37:23.598741 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 14:37:23.598741 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 14:37:23.598741 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 14:37:23.598741 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Jul 26 14:37:23.601343 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 58/118] 10.222.0.93 () {56 vars in 1114 bytes} [Tue Jul 26 14:37:23 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 451 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:37:23.607918 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f9dde6-ff1b-4105-9c76-ec4372885cc9 None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:37:23.673952 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 61/119] 10.222.0.93 () {58 vars in 1439 bytes} [Tue Jul 26 14:37:23 2022] PUT /identity/v3/projects/798795388b0c46a3a4ae48ca79f5c6ce/users/7295436e2b73480da2d21e361333fbb8/roles/8b8a4a451dc84c17bba824b2ff9cc4fe => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 14:37:23.773658 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52b8004-bad5-4e37-af57-1550353eef75 None None] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:23.774177 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52b8004-bad5-4e37-af57-1550353eef75 None None] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:23.774620 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52b8004-bad5-4e37-af57-1550353eef75 None None] PATH_INFO: `/` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:23.776772 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 62/120] 10.222.0.93 () {54 vars in 926 bytes} [Tue Jul 26 14:37:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 14:37:23.783847 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d417e602-79ef-45df-a46d-95cbee2d39c3 None None] REQUEST_METHOD: `POST` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:23.784376 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d417e602-79ef-45df-a46d-95cbee2d39c3 None None] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:23.784828 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d417e602-79ef-45df-a46d-95cbee2d39c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:23.820411 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f9dde6-ff1b-4105-9c76-ec4372885cc9 None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:37:23.830519 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.auth.core [None req-d417e602-79ef-45df-a46d-95cbee2d39c3 None None] MFA Rules not processed for user `e5ef88cc058f425b882bcb87a1e1e75c`. Rule list: `[]` (Enabled: `True`). {{(pid=87056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:37:23.832187 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.fernet_utils [None req-d417e602-79ef-45df-a46d-95cbee2d39c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:37:23.877978 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b872ef70-b6e9-41e8-9000-39522590ea20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:37:23.878967 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b872ef70-b6e9-41e8-9000-39522590ea20 None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:23.879440 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b872ef70-b6e9-41e8-9000-39522590ea20 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:23.882281 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b872ef70-b6e9-41e8-9000-39522590ea20 None admin] PATH_INFO: `/v3/roles` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:23.882281 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b872ef70-b6e9-41e8-9000-39522590ea20 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:37:23.882281 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b872ef70-b6e9-41e8-9000-39522590ea20 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:37:23.882772 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b872ef70-b6e9-41e8-9000-39522590ea20 None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:37:23.895280 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 59/121] 10.222.0.93 () {56 vars in 1111 bytes} [Tue Jul 26 14:37:23 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:37:23.902769 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b872ef70-b6e9-41e8-9000-39522590ea20 None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:37:23.979323 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:37:24.044079 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 63/122] 10.222.0.93 () {58 vars in 1023 bytes} [Tue Jul 26 14:37:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 14:37:24.048876 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff819c3-e8b0-4fbd-84b8-dcaa7c669985 None None] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:24.049379 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff819c3-e8b0-4fbd-84b8-dcaa7c669985 None None] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:24.049878 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff819c3-e8b0-4fbd-84b8-dcaa7c669985 None None] PATH_INFO: `/` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:24.054338 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 64/123] 10.222.0.93 () {54 vars in 926 bytes} [Tue Jul 26 14:37:24 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:37:24.058764 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d1a8c7-e446-4961-8149-9cbb719668ad None None] REQUEST_METHOD: `POST` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:24.059398 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d1a8c7-e446-4961-8149-9cbb719668ad None None] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:24.059877 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d1a8c7-e446-4961-8149-9cbb719668ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:24.090806 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.auth.core [None req-66d1a8c7-e446-4961-8149-9cbb719668ad None None] MFA Rules not processed for user `e5ef88cc058f425b882bcb87a1e1e75c`. Rule list: `[]` (Enabled: `True`). {{(pid=87056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:37:24.092334 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.fernet_utils [None req-66d1a8c7-e446-4961-8149-9cbb719668ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:37:24.126090 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b872ef70-b6e9-41e8-9000-39522590ea20 None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:37:24.160784 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:37:24.185622 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984f0d24-baa8-4b3c-81d3-55438f862247 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:37:24.186757 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984f0d24-baa8-4b3c-81d3-55438f862247 None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:24.187246 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984f0d24-baa8-4b3c-81d3-55438f862247 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:24.187720 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984f0d24-baa8-4b3c-81d3-55438f862247 None admin] PATH_INFO: `/v3/users/7295436e2b73480da2d21e361333fbb8` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:24.190505 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984f0d24-baa8-4b3c-81d3-55438f862247 None admin] RBAC: Authorizing `identity:get_user(user_id=7295436e2b73480da2d21e361333fbb8)` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:37:24.194465 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984f0d24-baa8-4b3c-81d3-55438f862247 None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:37:24.198640 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 60/124] 10.222.0.93 () {56 vars in 1177 bytes} [Tue Jul 26 14:37:23 2022] GET /identity/v3/users/7295436e2b73480da2d21e361333fbb8 => generated 275 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:37:24.200854 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984f0d24-baa8-4b3c-81d3-55438f862247 None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:37:24.243379 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 65/125] 10.222.0.93 () {58 vars in 1023 bytes} [Tue Jul 26 14:37:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 14:37:24.246316 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d1a8c7-e446-4961-8149-9cbb719668ad None None] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:37:24.420744 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:37:24.458190 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984f0d24-baa8-4b3c-81d3-55438f862247 None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:37:24.498653 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d1a8c7-e446-4961-8149-9cbb719668ad None None] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:37:24.542462 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227b16c5-2a58-4c6c-8dd0-1b5a64005c2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:37:24.544473 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227b16c5-2a58-4c6c-8dd0-1b5a64005c2b None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:24.545685 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227b16c5-2a58-4c6c-8dd0-1b5a64005c2b None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:24.546379 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227b16c5-2a58-4c6c-8dd0-1b5a64005c2b None admin] PATH_INFO: `/v3/projects/798795388b0c46a3a4ae48ca79f5c6ce` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:24.550054 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227b16c5-2a58-4c6c-8dd0-1b5a64005c2b None admin] RBAC: Authorizing `identity:get_project(project_id=798795388b0c46a3a4ae48ca79f5c6ce)` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:37:24.552410 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227b16c5-2a58-4c6c-8dd0-1b5a64005c2b None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:37:24.554841 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 66/126] 10.222.0.93 () {56 vars in 1186 bytes} [Tue Jul 26 14:37:24 2022] GET /identity/v3/projects/798795388b0c46a3a4ae48ca79f5c6ce => generated 298 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:37:24.557042 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff41b9ca-9d40-4b87-9bc2-173354185f8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:37:24.557972 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff41b9ca-9d40-4b87-9bc2-173354185f8c None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:24.558534 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff41b9ca-9d40-4b87-9bc2-173354185f8c None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:24.559024 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff41b9ca-9d40-4b87-9bc2-173354185f8c None admin] PATH_INFO: `/v3/roles/member` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:24.560690 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227b16c5-2a58-4c6c-8dd0-1b5a64005c2b None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:37:24.598766 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff41b9ca-9d40-4b87-9bc2-173354185f8c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 14:37:24.610620 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application [None req-ff41b9ca-9d40-4b87-9bc2-173354185f8c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 26 14:37:24.610620 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:37:24.610620 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:37:24.610620 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:37:24.610620 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:37:24.610620 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:37:24.610620 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:37:24.610620 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:37:24.610620 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:37:24.610620 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:37:24.610620 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:37:24.610620 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:37:24.610620 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 14:37:24.610620 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 14:37:24.610620 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 14:37:24.610620 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 14:37:24.611587 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 14:37:24.611587 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 14:37:24.611587 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 14:37:24.611587 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 14:37:24.611587 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:37:24.611587 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:37:24.611587 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:37:24.611587 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:37:24.611587 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:37:24.611587 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:37:24.611587 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:37:24.611587 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application with Lock( Jul 26 14:37:24.611587 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:37:24.611587 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:37:24.611587 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:37:24.611587 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:37:24.612370 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:37:24.612370 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:37:24.612370 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:37:24.612370 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:37:24.612370 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 14:37:24.612370 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 14:37:24.612370 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 14:37:24.612370 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 14:37:24.612370 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 14:37:24.612370 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 14:37:24.612370 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 26 14:37:24.612370 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Jul 26 14:37:24.618232 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 61/127] 10.222.0.93 () {56 vars in 1099 bytes} [Tue Jul 26 14:37:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 418 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:37:24.622296 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff41b9ca-9d40-4b87-9bc2-173354185f8c None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:37:24.668377 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:37:24.768150 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227b16c5-2a58-4c6c-8dd0-1b5a64005c2b None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:37:24.811392 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2328a756-52bb-45d3-bd6c-30fa48a96cae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:37:24.812438 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2328a756-52bb-45d3-bd6c-30fa48a96cae None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:24.813039 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2328a756-52bb-45d3-bd6c-30fa48a96cae None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:24.813521 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2328a756-52bb-45d3-bd6c-30fa48a96cae None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:24.850826 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2328a756-52bb-45d3-bd6c-30fa48a96cae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 14:37:24.858812 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application [None req-2328a756-52bb-45d3-bd6c-30fa48a96cae None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 14:37:24.858812 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:37:24.858812 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:37:24.858812 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:37:24.858812 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:37:24.858812 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:37:24.858812 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:37:24.858812 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:37:24.858812 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:37:24.858812 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:37:24.858812 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:37:24.858812 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:37:24.858812 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 14:37:24.858812 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 14:37:24.858812 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 14:37:24.858812 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 14:37:24.859792 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 14:37:24.859792 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 14:37:24.859792 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 14:37:24.859792 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 14:37:24.859792 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:37:24.859792 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:37:24.859792 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:37:24.859792 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:37:24.859792 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:37:24.859792 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:37:24.859792 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:37:24.859792 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application with Lock( Jul 26 14:37:24.859792 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:37:24.859792 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:37:24.859792 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:37:24.859792 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:37:24.860567 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:37:24.860567 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:37:24.860567 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:37:24.860567 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:37:24.860567 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 14:37:24.860567 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 14:37:24.860567 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 14:37:24.860567 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 14:37:24.860567 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 14:37:24.860567 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 14:37:24.860567 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 14:37:24.860567 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Jul 26 14:37:24.863340 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 67/128] 10.222.0.93 () {56 vars in 1096 bytes} [Tue Jul 26 14:37:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:37:24.864497 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2328a756-52bb-45d3-bd6c-30fa48a96cae None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:37:24.936365 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff41b9ca-9d40-4b87-9bc2-173354185f8c None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:37:25.001727 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:37:25.012150 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2328a756-52bb-45d3-bd6c-30fa48a96cae None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:37:25.053558 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1ea976-9755-4311-819c-49f249fdea50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:37:25.054148 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1ea976-9755-4311-819c-49f249fdea50 None admin] REQUEST_METHOD: `PUT` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:25.054465 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1ea976-9755-4311-819c-49f249fdea50 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:25.054748 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1ea976-9755-4311-819c-49f249fdea50 None admin] PATH_INFO: `/v3/projects/798795388b0c46a3a4ae48ca79f5c6ce/users/7295436e2b73480da2d21e361333fbb8/roles/ef1a806f8d774452a6536b57a4670ceb` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:25.061370 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1ea976-9755-4311-819c-49f249fdea50 None admin] RBAC: Authorizing `identity:create_grant(project_id=798795388b0c46a3a4ae48ca79f5c6ce, user_id=7295436e2b73480da2d21e361333fbb8, role_id=ef1a806f8d774452a6536b57a4670ceb)` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:37:25.061370 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1ea976-9755-4311-819c-49f249fdea50 None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:37:25.066373 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3e0e2f-54aa-456b-a47d-792cb9fa2deb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:37:25.067201 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3e0e2f-54aa-456b-a47d-792cb9fa2deb None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:25.067591 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3e0e2f-54aa-456b-a47d-792cb9fa2deb None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:25.067972 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3e0e2f-54aa-456b-a47d-792cb9fa2deb None admin] PATH_INFO: `/v3/roles` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:25.068873 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3e0e2f-54aa-456b-a47d-792cb9fa2deb None admin] RBAC: Adding query filter params (name=member) {{(pid=87056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:37:25.069345 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3e0e2f-54aa-456b-a47d-792cb9fa2deb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:37:25.071002 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3e0e2f-54aa-456b-a47d-792cb9fa2deb None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:37:25.081923 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 68/129] 10.222.0.93 () {56 vars in 1101 bytes} [Tue Jul 26 14:37:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:37:25.082967 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3e0e2f-54aa-456b-a47d-792cb9fa2deb None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:37:25.218963 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 62/130] 10.222.0.93 () {58 vars in 1439 bytes} [Tue Jul 26 14:37:24 2022] PUT /identity/v3/projects/798795388b0c46a3a4ae48ca79f5c6ce/users/7295436e2b73480da2d21e361333fbb8/roles/ef1a806f8d774452a6536b57a4670ceb => generated 0 bytes in 598 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 14:37:25.228270 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1ea976-9755-4311-819c-49f249fdea50 None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:37:25.233466 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3e0e2f-54aa-456b-a47d-792cb9fa2deb None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:37:25.236620 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:37:25.323608 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbd2e4f-b216-45d5-965b-fb2e799dd01e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:37:25.324183 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbd2e4f-b216-45d5-965b-fb2e799dd01e None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:25.324467 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbd2e4f-b216-45d5-965b-fb2e799dd01e None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:25.324741 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbd2e4f-b216-45d5-965b-fb2e799dd01e None admin] PATH_INFO: `/v3/roles` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:25.329954 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbd2e4f-b216-45d5-965b-fb2e799dd01e None admin] RBAC: Adding query filter params (name=admin) {{(pid=87056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:37:25.329954 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbd2e4f-b216-45d5-965b-fb2e799dd01e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:37:25.329954 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbd2e4f-b216-45d5-965b-fb2e799dd01e None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:37:25.345849 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 69/131] 10.222.0.93 () {56 vars in 1099 bytes} [Tue Jul 26 14:37:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:37:25.347720 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307093d8-c96e-4a23-aed9-1daa7c79a8bc None None] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:25.348278 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307093d8-c96e-4a23-aed9-1daa7c79a8bc None None] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:25.348760 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307093d8-c96e-4a23-aed9-1daa7c79a8bc None None] PATH_INFO: `/` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:25.350820 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 70/132] 10.222.0.93 () {54 vars in 926 bytes} [Tue Jul 26 14:37:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:37:25.351921 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307093d8-c96e-4a23-aed9-1daa7c79a8bc None None] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:37:25.414282 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:37:25.462222 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1ea976-9755-4311-819c-49f249fdea50 None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:37:25.530627 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d424ef90-6977-467e-8eed-cc7b90f75833 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:37:25.532144 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d424ef90-6977-467e-8eed-cc7b90f75833 None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:25.532660 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d424ef90-6977-467e-8eed-cc7b90f75833 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:25.533160 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d424ef90-6977-467e-8eed-cc7b90f75833 None admin] PATH_INFO: `/v3/users/7295436e2b73480da2d21e361333fbb8` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:25.535535 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d424ef90-6977-467e-8eed-cc7b90f75833 None admin] RBAC: Authorizing `identity:get_user(user_id=7295436e2b73480da2d21e361333fbb8)` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:37:25.538684 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d424ef90-6977-467e-8eed-cc7b90f75833 None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:37:25.542478 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 63/133] 10.222.0.93 () {56 vars in 1177 bytes} [Tue Jul 26 14:37:25 2022] GET /identity/v3/users/7295436e2b73480da2d21e361333fbb8 => generated 275 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:37:25.544763 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f24244-b877-4bf6-b425-0be2dc2c3c8e None None] REQUEST_METHOD: `POST` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:25.545258 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f24244-b877-4bf6-b425-0be2dc2c3c8e None None] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:25.545738 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f24244-b877-4bf6-b425-0be2dc2c3c8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:25.559137 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307093d8-c96e-4a23-aed9-1daa7c79a8bc None None] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:37:25.578882 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.auth.core [None req-29f24244-b877-4bf6-b425-0be2dc2c3c8e None None] MFA Rules not processed for user `e5ef88cc058f425b882bcb87a1e1e75c`. Rule list: `[]` (Enabled: `True`). {{(pid=87055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:37:25.581047 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.fernet_utils [None req-29f24244-b877-4bf6-b425-0be2dc2c3c8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:37:25.600034 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe7b3ff-6ea7-4c56-8828-31b902db88d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:37:25.600867 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe7b3ff-6ea7-4c56-8828-31b902db88d4 None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:25.601312 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe7b3ff-6ea7-4c56-8828-31b902db88d4 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:25.601603 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe7b3ff-6ea7-4c56-8828-31b902db88d4 None admin] PATH_INFO: `/v3/users/e5ef88cc058f425b882bcb87a1e1e75c` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:25.603462 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe7b3ff-6ea7-4c56-8828-31b902db88d4 None admin] RBAC: Authorizing `identity:get_user(user_id=e5ef88cc058f425b882bcb87a1e1e75c)` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:37:25.605114 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe7b3ff-6ea7-4c56-8828-31b902db88d4 None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:37:25.607083 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 71/134] 10.222.0.93 () {56 vars in 1177 bytes} [Tue Jul 26 14:37:25 2022] GET /identity/v3/users/e5ef88cc058f425b882bcb87a1e1e75c => generated 247 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:37:25.607702 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe7b3ff-6ea7-4c56-8828-31b902db88d4 None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:37:25.709132 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:37:25.713555 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:37:25.718537 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 64/135] 10.222.0.93 () {58 vars in 1023 bytes} [Tue Jul 26 14:37:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 14:37:25.720078 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f24244-b877-4bf6-b425-0be2dc2c3c8e None None] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:37:25.728763 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe7b3ff-6ea7-4c56-8828-31b902db88d4 None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:37:25.769303 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5b13e6-7a05-4889-b649-80af15d07fd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:37:25.770134 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5b13e6-7a05-4889-b649-80af15d07fd0 None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:25.770456 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5b13e6-7a05-4889-b649-80af15d07fd0 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:25.774410 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5b13e6-7a05-4889-b649-80af15d07fd0 None admin] PATH_INFO: `/v3/projects/507ce424ca774469b12dd7bbc4b4c17e` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:25.774410 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5b13e6-7a05-4889-b649-80af15d07fd0 None admin] RBAC: Authorizing `identity:get_project(project_id=507ce424ca774469b12dd7bbc4b4c17e)` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:37:25.774410 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5b13e6-7a05-4889-b649-80af15d07fd0 None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:37:25.776103 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 72/136] 10.222.0.93 () {56 vars in 1186 bytes} [Tue Jul 26 14:37:25 2022] GET /identity/v3/projects/507ce424ca774469b12dd7bbc4b4c17e => generated 312 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:37:25.783723 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5b13e6-7a05-4889-b649-80af15d07fd0 None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:37:25.929987 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5b13e6-7a05-4889-b649-80af15d07fd0 None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:37:25.965195 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f24244-b877-4bf6-b425-0be2dc2c3c8e None None] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:37:26.032556 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb57dc00-8787-480d-8d67-847dcca0b855 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:37:26.033644 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb57dc00-8787-480d-8d67-847dcca0b855 None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:26.034141 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb57dc00-8787-480d-8d67-847dcca0b855 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:26.034708 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb57dc00-8787-480d-8d67-847dcca0b855 None admin] PATH_INFO: `/v3/projects/798795388b0c46a3a4ae48ca79f5c6ce` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:26.036835 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb57dc00-8787-480d-8d67-847dcca0b855 None admin] RBAC: Authorizing `identity:get_project(project_id=798795388b0c46a3a4ae48ca79f5c6ce)` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:37:26.038517 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e91ecc-6d2a-4641-83bc-73217bd8e4eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:37:26.039624 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb57dc00-8787-480d-8d67-847dcca0b855 None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:37:26.039769 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e91ecc-6d2a-4641-83bc-73217bd8e4eb None admin] REQUEST_METHOD: `PUT` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:26.041193 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e91ecc-6d2a-4641-83bc-73217bd8e4eb None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:26.041868 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e91ecc-6d2a-4641-83bc-73217bd8e4eb None admin] PATH_INFO: `/v3/projects/507ce424ca774469b12dd7bbc4b4c17e/users/7295436e2b73480da2d21e361333fbb8/roles/8b8a4a451dc84c17bba824b2ff9cc4fe` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:26.044146 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 65/137] 10.222.0.93 () {56 vars in 1186 bytes} [Tue Jul 26 14:37:25 2022] GET /identity/v3/projects/798795388b0c46a3a4ae48ca79f5c6ce => generated 298 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:37:26.045102 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e91ecc-6d2a-4641-83bc-73217bd8e4eb None admin] RBAC: Authorizing `identity:create_grant(project_id=507ce424ca774469b12dd7bbc4b4c17e, user_id=7295436e2b73480da2d21e361333fbb8, role_id=8b8a4a451dc84c17bba824b2ff9cc4fe)` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:37:26.045447 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb57dc00-8787-480d-8d67-847dcca0b855 None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:37:26.052065 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e91ecc-6d2a-4641-83bc-73217bd8e4eb None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:37:26.136931 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:37:26.178153 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb57dc00-8787-480d-8d67-847dcca0b855 None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:37:26.225863 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd7b8be-4f4b-46ab-ba8c-7c04a3ff2204 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:37:26.226490 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd7b8be-4f4b-46ab-ba8c-7c04a3ff2204 None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:26.226772 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd7b8be-4f4b-46ab-ba8c-7c04a3ff2204 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:26.227052 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd7b8be-4f4b-46ab-ba8c-7c04a3ff2204 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:26.228359 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd7b8be-4f4b-46ab-ba8c-7c04a3ff2204 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:37:26.229841 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd7b8be-4f4b-46ab-ba8c-7c04a3ff2204 None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:37:26.231785 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 66/138] 10.222.0.93 () {56 vars in 1108 bytes} [Tue Jul 26 14:37:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:37:26.232360 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd7b8be-4f4b-46ab-ba8c-7c04a3ff2204 None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:37:26.255334 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 73/139] 10.222.0.93 () {58 vars in 1439 bytes} [Tue Jul 26 14:37:25 2022] PUT /identity/v3/projects/507ce424ca774469b12dd7bbc4b4c17e/users/7295436e2b73480da2d21e361333fbb8/roles/8b8a4a451dc84c17bba824b2ff9cc4fe => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 14:37:26.256805 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6336e9-1cb9-419a-b3e6-adc204ce35b0 None None] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:26.257138 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6336e9-1cb9-419a-b3e6-adc204ce35b0 None None] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:26.257470 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6336e9-1cb9-419a-b3e6-adc204ce35b0 None None] PATH_INFO: `/` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:26.259923 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 74/140] 10.222.0.93 () {54 vars in 926 bytes} [Tue Jul 26 14:37:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:37:26.266550 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6336e9-1cb9-419a-b3e6-adc204ce35b0 None None] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:37:26.320371 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:37:26.467599 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd7b8be-4f4b-46ab-ba8c-7c04a3ff2204 None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:37:26.512725 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6336e9-1cb9-419a-b3e6-adc204ce35b0 None None] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:37:26.516838 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3d593f-38a9-457f-a4ff-ab2cf8feec44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:37:26.517595 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3d593f-38a9-457f-a4ff-ab2cf8feec44 None admin] REQUEST_METHOD: `PUT` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:26.517884 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3d593f-38a9-457f-a4ff-ab2cf8feec44 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:26.518172 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3d593f-38a9-457f-a4ff-ab2cf8feec44 None admin] PATH_INFO: `/v3/projects/798795388b0c46a3a4ae48ca79f5c6ce/users/e5ef88cc058f425b882bcb87a1e1e75c/roles/94e105ff8ee4486abd501415cc05ba38` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:26.523837 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3d593f-38a9-457f-a4ff-ab2cf8feec44 None admin] RBAC: Authorizing `identity:create_grant(project_id=798795388b0c46a3a4ae48ca79f5c6ce, user_id=e5ef88cc058f425b882bcb87a1e1e75c, role_id=94e105ff8ee4486abd501415cc05ba38)` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:37:26.526125 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3d593f-38a9-457f-a4ff-ab2cf8feec44 None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:37:26.529956 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:37:26.560583 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958be7d5-2fba-4ea2-9e54-f1ecab1c2717 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:37:26.562096 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958be7d5-2fba-4ea2-9e54-f1ecab1c2717 None admin] REQUEST_METHOD: `POST` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:26.562697 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958be7d5-2fba-4ea2-9e54-f1ecab1c2717 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:26.563199 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958be7d5-2fba-4ea2-9e54-f1ecab1c2717 None admin] PATH_INFO: `/v3/users` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:26.564154 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958be7d5-2fba-4ea2-9e54-f1ecab1c2717 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:37:26.565968 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958be7d5-2fba-4ea2-9e54-f1ecab1c2717 None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:37:26.686737 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 67/141] 10.222.0.93 () {58 vars in 1439 bytes} [Tue Jul 26 14:37:26 2022] PUT /identity/v3/projects/798795388b0c46a3a4ae48ca79f5c6ce/users/e5ef88cc058f425b882bcb87a1e1e75c/roles/94e105ff8ee4486abd501415cc05ba38 => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 14:37:26.688174 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8acc45-e020-4d4c-83fc-2d35d99a3903 None None] REQUEST_METHOD: `POST` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:26.688783 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8acc45-e020-4d4c-83fc-2d35d99a3903 None None] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:26.690287 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8acc45-e020-4d4c-83fc-2d35d99a3903 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:26.705953 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 75/142] 10.222.0.93 () {60 vars in 1132 bytes} [Tue Jul 26 14:37:26 2022] POST /identity/v3/users => generated 283 bytes in 446 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 14:37:26.707456 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d3533b-8733-45b5-8a40-e5258a50e0dc None None] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:26.707740 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d3533b-8733-45b5-8a40-e5258a50e0dc None None] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:26.714654 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d3533b-8733-45b5-8a40-e5258a50e0dc None None] PATH_INFO: `/` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:26.716235 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 76/143] 10.222.0.93 () {54 vars in 926 bytes} [Tue Jul 26 14:37:26 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:37:26.726160 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad18dbb1-dc1a-4cc0-b9b9-39bf5d6f2611 None None] REQUEST_METHOD: `POST` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:26.728938 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad18dbb1-dc1a-4cc0-b9b9-39bf5d6f2611 None None] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:26.728938 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad18dbb1-dc1a-4cc0-b9b9-39bf5d6f2611 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:26.730708 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.auth.core [None req-cd8acc45-e020-4d4c-83fc-2d35d99a3903 None None] MFA Rules not processed for user `e5ef88cc058f425b882bcb87a1e1e75c`. Rule list: `[]` (Enabled: `True`). {{(pid=87055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:37:26.732109 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.fernet_utils [None req-cd8acc45-e020-4d4c-83fc-2d35d99a3903 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:37:26.771189 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.auth.core [None req-ad18dbb1-dc1a-4cc0-b9b9-39bf5d6f2611 None None] MFA Rules not processed for user `e5ef88cc058f425b882bcb87a1e1e75c`. Rule list: `[]` (Enabled: `True`). {{(pid=87056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:37:26.772440 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.fernet_utils [None req-ad18dbb1-dc1a-4cc0-b9b9-39bf5d6f2611 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:37:26.938366 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 68/144] 10.222.0.93 () {58 vars in 1023 bytes} [Tue Jul 26 14:37:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 14:37:26.951908 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 77/145] 10.222.0.93 () {58 vars in 1023 bytes} [Tue Jul 26 14:37:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 14:37:26.971219 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8acc45-e020-4d4c-83fc-2d35d99a3903 None None] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:37:27.019490 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad18dbb1-dc1a-4cc0-b9b9-39bf5d6f2611 None None] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:37:27.023502 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:37:27.210417 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8acc45-e020-4d4c-83fc-2d35d99a3903 None None] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:37:27.262625 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad18dbb1-dc1a-4cc0-b9b9-39bf5d6f2611 None None] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:37:27.277738 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:37:27.315289 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da814009-f218-46a1-8777-1237a441994c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:37:27.316389 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da814009-f218-46a1-8777-1237a441994c None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:27.316949 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da814009-f218-46a1-8777-1237a441994c None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:27.317456 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da814009-f218-46a1-8777-1237a441994c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:27.357869 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da814009-f218-46a1-8777-1237a441994c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 14:37:27.372418 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1f2e6f-8028-491c-a217-0e6963e5320d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:37:27.373657 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1f2e6f-8028-491c-a217-0e6963e5320d None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:27.374152 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1f2e6f-8028-491c-a217-0e6963e5320d None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:27.374678 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1f2e6f-8028-491c-a217-0e6963e5320d None admin] PATH_INFO: `/v3/roles/member` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:27.386309 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application [None req-da814009-f218-46a1-8777-1237a441994c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 26 14:37:27.386309 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:37:27.386309 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:37:27.386309 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:37:27.386309 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:37:27.386309 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:37:27.386309 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:37:27.386309 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:37:27.386309 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:37:27.386309 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:37:27.386309 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:37:27.386309 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:37:27.386309 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 14:37:27.386309 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 14:37:27.386309 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 14:37:27.386309 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 14:37:27.387971 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 14:37:27.387971 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 14:37:27.387971 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 14:37:27.387971 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 14:37:27.387971 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:37:27.387971 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:37:27.387971 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:37:27.387971 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:37:27.387971 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:37:27.387971 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:37:27.387971 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:37:27.387971 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application with Lock( Jul 26 14:37:27.387971 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:37:27.387971 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:37:27.387971 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:37:27.387971 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:37:27.389447 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:37:27.389447 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:37:27.389447 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:37:27.389447 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:37:27.389447 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 14:37:27.389447 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 14:37:27.389447 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 14:37:27.389447 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 14:37:27.389447 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 14:37:27.389447 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 14:37:27.389447 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 26 14:37:27.389447 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Jul 26 14:37:27.389447 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 69/146] 10.222.0.93 () {56 vars in 1099 bytes} [Tue Jul 26 14:37:26 2022] GET /identity/v3/roles/reader => generated 84 bytes in 418 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:37:27.396480 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da814009-f218-46a1-8777-1237a441994c None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:37:27.429298 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1f2e6f-8028-491c-a217-0e6963e5320d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 14:37:27.439462 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application [None req-4f1f2e6f-8028-491c-a217-0e6963e5320d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 26 14:37:27.439462 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:37:27.439462 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:37:27.439462 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:37:27.439462 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:37:27.439462 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:37:27.439462 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:37:27.439462 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:37:27.439462 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:37:27.439462 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:37:27.439462 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:37:27.439462 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:37:27.439462 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 14:37:27.439462 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 14:37:27.439462 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 14:37:27.439462 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 14:37:27.441064 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 14:37:27.441064 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 14:37:27.441064 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 14:37:27.441064 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 14:37:27.441064 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:37:27.441064 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:37:27.441064 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:37:27.441064 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:37:27.441064 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:37:27.441064 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:37:27.441064 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:37:27.441064 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application with Lock( Jul 26 14:37:27.441064 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:37:27.441064 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:37:27.441064 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:37:27.441064 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:37:27.446077 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:37:27.446077 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:37:27.446077 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:37:27.446077 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:37:27.446077 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 14:37:27.446077 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 14:37:27.446077 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 14:37:27.446077 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 14:37:27.446077 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 14:37:27.446077 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 14:37:27.446077 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 26 14:37:27.446077 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Jul 26 14:37:27.446077 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 78/147] 10.222.0.93 () {56 vars in 1099 bytes} [Tue Jul 26 14:37:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 424 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:37:27.458865 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1f2e6f-8028-491c-a217-0e6963e5320d None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:37:27.570382 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:37:27.622912 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1f2e6f-8028-491c-a217-0e6963e5320d None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:37:27.668024 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2f12b7-1c4b-42a5-8fd8-820eddecea8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:37:27.668674 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2f12b7-1c4b-42a5-8fd8-820eddecea8d None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:27.669019 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2f12b7-1c4b-42a5-8fd8-820eddecea8d None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:27.669310 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2f12b7-1c4b-42a5-8fd8-820eddecea8d None admin] PATH_INFO: `/v3/roles` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:27.670661 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2f12b7-1c4b-42a5-8fd8-820eddecea8d None admin] RBAC: Adding query filter params (name=member) {{(pid=87056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:37:27.670983 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2f12b7-1c4b-42a5-8fd8-820eddecea8d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:37:27.672603 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2f12b7-1c4b-42a5-8fd8-820eddecea8d None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:37:27.675493 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da814009-f218-46a1-8777-1237a441994c None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:37:27.684804 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 79/148] 10.222.0.93 () {56 vars in 1101 bytes} [Tue Jul 26 14:37:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:37:27.703710 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2f12b7-1c4b-42a5-8fd8-820eddecea8d None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:37:27.770900 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb1d4be-f106-441c-b6ff-68e26e35274f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:37:27.771608 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb1d4be-f106-441c-b6ff-68e26e35274f None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:27.771901 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb1d4be-f106-441c-b6ff-68e26e35274f None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:27.772185 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb1d4be-f106-441c-b6ff-68e26e35274f None admin] PATH_INFO: `/v3/roles` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:27.772956 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb1d4be-f106-441c-b6ff-68e26e35274f None admin] RBAC: Adding query filter params (name=reader) {{(pid=87055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:37:27.773276 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb1d4be-f106-441c-b6ff-68e26e35274f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:37:27.775378 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb1d4be-f106-441c-b6ff-68e26e35274f None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:37:27.791238 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 70/149] 10.222.0.93 () {56 vars in 1101 bytes} [Tue Jul 26 14:37:27 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 395 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:37:27.798953 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb1d4be-f106-441c-b6ff-68e26e35274f None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:37:27.880339 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2f12b7-1c4b-42a5-8fd8-820eddecea8d None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:37:27.954732 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:37:27.967021 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:37:27.994511 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdebea60-014d-4ecc-b3f7-0a18738abb42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:37:27.995379 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdebea60-014d-4ecc-b3f7-0a18738abb42 None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:27.995665 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdebea60-014d-4ecc-b3f7-0a18738abb42 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:27.995970 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdebea60-014d-4ecc-b3f7-0a18738abb42 None admin] PATH_INFO: `/v3/users/7295436e2b73480da2d21e361333fbb8` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:27.997262 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdebea60-014d-4ecc-b3f7-0a18738abb42 None admin] RBAC: Authorizing `identity:get_user(user_id=7295436e2b73480da2d21e361333fbb8)` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:37:27.998819 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdebea60-014d-4ecc-b3f7-0a18738abb42 None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:37:28.000584 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 80/150] 10.222.0.93 () {56 vars in 1177 bytes} [Tue Jul 26 14:37:27 2022] GET /identity/v3/users/7295436e2b73480da2d21e361333fbb8 => generated 275 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:37:28.030950 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdebea60-014d-4ecc-b3f7-0a18738abb42 None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:37:28.072211 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb1d4be-f106-441c-b6ff-68e26e35274f None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:37:28.132220 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a48412-5ac5-4cb2-93cb-40d88d3c5f12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:37:28.132808 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a48412-5ac5-4cb2-93cb-40d88d3c5f12 None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:28.133089 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a48412-5ac5-4cb2-93cb-40d88d3c5f12 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:28.133365 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a48412-5ac5-4cb2-93cb-40d88d3c5f12 None admin] PATH_INFO: `/v3/users/13cbdb2b220f42cd8737957639a98fe6` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:28.135925 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a48412-5ac5-4cb2-93cb-40d88d3c5f12 None admin] RBAC: Authorizing `identity:get_user(user_id=13cbdb2b220f42cd8737957639a98fe6)` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:37:28.137737 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a48412-5ac5-4cb2-93cb-40d88d3c5f12 None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:37:28.139532 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 71/151] 10.222.0.93 () {56 vars in 1177 bytes} [Tue Jul 26 14:37:27 2022] GET /identity/v3/users/13cbdb2b220f42cd8737957639a98fe6 => generated 289 bytes in 341 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:37:28.145292 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a48412-5ac5-4cb2-93cb-40d88d3c5f12 None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:37:28.277116 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdebea60-014d-4ecc-b3f7-0a18738abb42 None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:37:28.351147 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefd0f42-9a01-4a73-8892-2a5966d48c8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:37:28.351809 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefd0f42-9a01-4a73-8892-2a5966d48c8a None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:28.352096 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefd0f42-9a01-4a73-8892-2a5966d48c8a None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:28.352377 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefd0f42-9a01-4a73-8892-2a5966d48c8a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:28.366748 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a48412-5ac5-4cb2-93cb-40d88d3c5f12 None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:37:28.426774 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:37:28.463563 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5101ee1-c357-4576-9801-bde3bef7ed28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:37:28.464607 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5101ee1-c357-4576-9801-bde3bef7ed28 None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:28.465040 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5101ee1-c357-4576-9801-bde3bef7ed28 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:28.465447 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5101ee1-c357-4576-9801-bde3bef7ed28 None admin] PATH_INFO: `/v3/projects/798795388b0c46a3a4ae48ca79f5c6ce` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:28.467577 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5101ee1-c357-4576-9801-bde3bef7ed28 None admin] RBAC: Authorizing `identity:get_project(project_id=798795388b0c46a3a4ae48ca79f5c6ce)` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:37:28.470188 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5101ee1-c357-4576-9801-bde3bef7ed28 None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:37:28.473310 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 72/152] 10.222.0.93 () {56 vars in 1186 bytes} [Tue Jul 26 14:37:28 2022] GET /identity/v3/projects/798795388b0c46a3a4ae48ca79f5c6ce => generated 298 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:37:28.480030 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5101ee1-c357-4576-9801-bde3bef7ed28 None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:37:28.498664 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:37:28.522610 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefd0f42-9a01-4a73-8892-2a5966d48c8a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:37:28.525845 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefd0f42-9a01-4a73-8892-2a5966d48c8a None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:37:28.796845 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5101ee1-c357-4576-9801-bde3bef7ed28 None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:37:28.833094 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 81/153] 10.222.0.93 () {58 vars in 1282 bytes} [Tue Jul 26 14:37:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 803 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 26 14:37:28.835120 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a5fd74-1e40-453e-8713-36cfedae0f8c None None] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:28.838727 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a5fd74-1e40-453e-8713-36cfedae0f8c None None] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:28.839299 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a5fd74-1e40-453e-8713-36cfedae0f8c None None] PATH_INFO: `/` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:28.841011 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 82/154] 10.222.0.93 () {54 vars in 926 bytes} [Tue Jul 26 14:37:28 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:37:28.844182 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a5fd74-1e40-453e-8713-36cfedae0f8c None None] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:37:28.904154 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d79edf4-f36c-4bbd-88b2-f618b62d768e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:37:28.905297 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d79edf4-f36c-4bbd-88b2-f618b62d768e None admin] REQUEST_METHOD: `PUT` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:28.907132 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d79edf4-f36c-4bbd-88b2-f618b62d768e None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:28.907651 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d79edf4-f36c-4bbd-88b2-f618b62d768e None admin] PATH_INFO: `/v3/projects/798795388b0c46a3a4ae48ca79f5c6ce/users/13cbdb2b220f42cd8737957639a98fe6/roles/8b206d8d963645f6bd492384b6c5d39f` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:28.916724 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d79edf4-f36c-4bbd-88b2-f618b62d768e None admin] RBAC: Authorizing `identity:create_grant(project_id=798795388b0c46a3a4ae48ca79f5c6ce, user_id=13cbdb2b220f42cd8737957639a98fe6, role_id=8b206d8d963645f6bd492384b6c5d39f)` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:37:28.918363 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d79edf4-f36c-4bbd-88b2-f618b62d768e None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:37:29.028629 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 73/155] 10.222.0.93 () {58 vars in 1439 bytes} [Tue Jul 26 14:37:28 2022] PUT /identity/v3/projects/798795388b0c46a3a4ae48ca79f5c6ce/users/13cbdb2b220f42cd8737957639a98fe6/roles/8b206d8d963645f6bd492384b6c5d39f => generated 0 bytes in 549 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 14:37:29.030130 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459d6443-0eef-4703-8286-4e4f569ff7e1 None None] REQUEST_METHOD: `POST` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:29.030448 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459d6443-0eef-4703-8286-4e4f569ff7e1 None None] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:29.030736 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459d6443-0eef-4703-8286-4e4f569ff7e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:29.047579 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:37:29.071002 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a5fd74-1e40-453e-8713-36cfedae0f8c None None] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:37:29.075576 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.auth.core [None req-459d6443-0eef-4703-8286-4e4f569ff7e1 None None] MFA Rules not processed for user `e5ef88cc058f425b882bcb87a1e1e75c`. Rule list: `[]` (Enabled: `True`). {{(pid=87055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:37:29.077050 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.fernet_utils [None req-459d6443-0eef-4703-8286-4e4f569ff7e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:37:29.170281 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:37:29.191139 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a4bd1e-c65f-46fb-b843-531910faa50e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:37:29.191996 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a4bd1e-c65f-46fb-b843-531910faa50e None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:29.192408 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a4bd1e-c65f-46fb-b843-531910faa50e None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:29.192830 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a4bd1e-c65f-46fb-b843-531910faa50e None admin] PATH_INFO: `/v3/projects/798795388b0c46a3a4ae48ca79f5c6ce` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:29.194290 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a4bd1e-c65f-46fb-b843-531910faa50e None admin] RBAC: Authorizing `identity:get_project(project_id=798795388b0c46a3a4ae48ca79f5c6ce)` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:37:29.195937 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a4bd1e-c65f-46fb-b843-531910faa50e None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:37:29.198843 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 83/156] 10.222.0.93 () {56 vars in 1186 bytes} [Tue Jul 26 14:37:28 2022] GET /identity/v3/projects/798795388b0c46a3a4ae48ca79f5c6ce => generated 298 bytes in 355 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:37:29.204561 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 74/157] 10.222.0.93 () {58 vars in 1023 bytes} [Tue Jul 26 14:37:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 14:37:29.208147 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a4bd1e-c65f-46fb-b843-531910faa50e None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:37:29.266934 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459d6443-0eef-4703-8286-4e4f569ff7e1 None None] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:37:29.474870 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a4bd1e-c65f-46fb-b843-531910faa50e None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:37:29.495504 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459d6443-0eef-4703-8286-4e4f569ff7e1 None None] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:37:29.566178 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4024e3-62b0-42f3-a22a-19902d8cfa27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:37:29.566888 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4024e3-62b0-42f3-a22a-19902d8cfa27 None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:29.567177 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4024e3-62b0-42f3-a22a-19902d8cfa27 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:29.567457 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4024e3-62b0-42f3-a22a-19902d8cfa27 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:29.571795 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a7d673-64e2-4091-9978-57b8e123cd5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:37:29.572371 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a7d673-64e2-4091-9978-57b8e123cd5d None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:29.572624 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a7d673-64e2-4091-9978-57b8e123cd5d None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:29.572894 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a7d673-64e2-4091-9978-57b8e123cd5d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:29.573706 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a7d673-64e2-4091-9978-57b8e123cd5d None admin] RBAC: Adding query filter params (role.id=8b8a4a451dc84c17bba824b2ff9cc4fe, scope.project.id=798795388b0c46a3a4ae48ca79f5c6ce, user.id=7295436e2b73480da2d21e361333fbb8) {{(pid=87056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:37:29.574018 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a7d673-64e2-4091-9978-57b8e123cd5d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:37:29.575540 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a7d673-64e2-4091-9978-57b8e123cd5d None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:37:29.588891 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 84/158] 10.222.0.93 () {56 vars in 1374 bytes} [Tue Jul 26 14:37:29 2022] GET /identity/v3/role_assignments?user.id=7295436e2b73480da2d21e361333fbb8&scope.project.id=798795388b0c46a3a4ae48ca79f5c6ce&role.id=8b8a4a451dc84c17bba824b2ff9cc4fe => generated 608 bytes in 381 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:37:29.590102 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4024e3-62b0-42f3-a22a-19902d8cfa27 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 14:37:29.595313 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application [None req-cf4024e3-62b0-42f3-a22a-19902d8cfa27 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 14:37:29.595313 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:37:29.595313 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:37:29.595313 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:37:29.595313 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:37:29.595313 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:37:29.595313 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:37:29.595313 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:37:29.595313 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:37:29.595313 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:37:29.595313 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:37:29.595313 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:37:29.595313 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 14:37:29.595313 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 14:37:29.595313 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 14:37:29.595313 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 14:37:29.596244 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 14:37:29.596244 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 14:37:29.596244 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 14:37:29.596244 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 14:37:29.596244 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:37:29.596244 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:37:29.596244 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:37:29.596244 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:37:29.596244 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:37:29.596244 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:37:29.596244 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:37:29.596244 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application with Lock( Jul 26 14:37:29.596244 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:37:29.596244 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:37:29.596244 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:37:29.596244 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:37:29.597017 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:37:29.597017 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:37:29.597017 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:37:29.597017 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:37:29.597017 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 14:37:29.597017 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 14:37:29.597017 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 14:37:29.597017 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 14:37:29.597017 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 14:37:29.597017 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 14:37:29.597017 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 14:37:29.597017 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Jul 26 14:37:29.597017 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 75/159] 10.222.0.93 () {56 vars in 1114 bytes} [Tue Jul 26 14:37:29 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 330 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:37:29.603984 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a7d673-64e2-4091-9978-57b8e123cd5d None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:37:29.651108 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:37:29.782048 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a7d673-64e2-4091-9978-57b8e123cd5d None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:37:29.830093 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433f9587-abc5-4c0e-837c-a8049dbc368b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:37:29.830789 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433f9587-abc5-4c0e-837c-a8049dbc368b None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:29.831070 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433f9587-abc5-4c0e-837c-a8049dbc368b None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:29.831348 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433f9587-abc5-4c0e-837c-a8049dbc368b None admin] PATH_INFO: `/v3/roles` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:29.832108 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433f9587-abc5-4c0e-837c-a8049dbc368b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:37:29.832414 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433f9587-abc5-4c0e-837c-a8049dbc368b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:37:29.833878 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433f9587-abc5-4c0e-837c-a8049dbc368b None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:37:29.847203 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 85/160] 10.222.0.93 () {56 vars in 1111 bytes} [Tue Jul 26 14:37:29 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:37:29.853056 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4024e3-62b0-42f3-a22a-19902d8cfa27 None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:37:29.991122 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:37:30.104893 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c53c376-32e6-4b89-a464-298514c28a46 None None] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:30.105300 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c53c376-32e6-4b89-a464-298514c28a46 None None] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:30.105524 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c53c376-32e6-4b89-a464-298514c28a46 None None] PATH_INFO: `/` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:30.107295 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 86/161] 10.222.0.93 () {54 vars in 926 bytes} [Tue Jul 26 14:37:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:37:30.115908 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9ed0d2-d6b7-4c80-9b07-189a53721a60 None None] REQUEST_METHOD: `POST` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:30.116230 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9ed0d2-d6b7-4c80-9b07-189a53721a60 None None] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:30.116581 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9ed0d2-d6b7-4c80-9b07-189a53721a60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:30.159385 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.auth.core [None req-ca9ed0d2-d6b7-4c80-9b07-189a53721a60 None None] MFA Rules not processed for user `e5ef88cc058f425b882bcb87a1e1e75c`. Rule list: `[]` (Enabled: `True`). {{(pid=87056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:37:30.160627 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.fernet_utils [None req-ca9ed0d2-d6b7-4c80-9b07-189a53721a60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:37:30.206422 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4024e3-62b0-42f3-a22a-19902d8cfa27 None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:37:30.316368 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76374d8-66ca-43d1-bda6-f7af96204f48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:37:30.318380 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76374d8-66ca-43d1-bda6-f7af96204f48 None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:30.318873 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76374d8-66ca-43d1-bda6-f7af96204f48 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:30.319588 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76374d8-66ca-43d1-bda6-f7af96204f48 None admin] PATH_INFO: `/v3/users/7295436e2b73480da2d21e361333fbb8` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:30.322792 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76374d8-66ca-43d1-bda6-f7af96204f48 None admin] RBAC: Authorizing `identity:get_user(user_id=7295436e2b73480da2d21e361333fbb8)` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:37:30.325880 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76374d8-66ca-43d1-bda6-f7af96204f48 None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:37:30.331948 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 76/162] 10.222.0.93 () {56 vars in 1177 bytes} [Tue Jul 26 14:37:29 2022] GET /identity/v3/users/7295436e2b73480da2d21e361333fbb8 => generated 275 bytes in 480 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:37:30.342905 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76374d8-66ca-43d1-bda6-f7af96204f48 None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:37:30.365058 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 87/163] 10.222.0.93 () {58 vars in 1023 bytes} [Tue Jul 26 14:37:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 14:37:30.418970 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9ed0d2-d6b7-4c80-9b07-189a53721a60 None None] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:37:30.466634 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:37:30.603402 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76374d8-66ca-43d1-bda6-f7af96204f48 None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:37:30.606471 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:37:30.700157 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd570490-2904-41c2-965e-571877dbabd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:37:30.700829 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd570490-2904-41c2-965e-571877dbabd0 None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:30.701797 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd570490-2904-41c2-965e-571877dbabd0 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:30.702328 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd570490-2904-41c2-965e-571877dbabd0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:30.798055 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9ed0d2-d6b7-4c80-9b07-189a53721a60 None None] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:37:30.933908 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417bdfdc-8364-4836-a9f7-ebecac0e7422 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:37:30.935063 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417bdfdc-8364-4836-a9f7-ebecac0e7422 None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:30.935525 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417bdfdc-8364-4836-a9f7-ebecac0e7422 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:30.936017 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417bdfdc-8364-4836-a9f7-ebecac0e7422 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:30.938345 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd570490-2904-41c2-965e-571877dbabd0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:37:30.941184 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd570490-2904-41c2-965e-571877dbabd0 None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:37:30.984911 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417bdfdc-8364-4836-a9f7-ebecac0e7422 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 14:37:31.005288 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application [None req-417bdfdc-8364-4836-a9f7-ebecac0e7422 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 26 14:37:31.005288 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:37:31.005288 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:37:31.005288 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:37:31.005288 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:37:31.005288 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:37:31.005288 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:37:31.005288 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:37:31.005288 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:37:31.005288 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:37:31.005288 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:37:31.005288 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:37:31.005288 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 14:37:31.005288 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 14:37:31.005288 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 14:37:31.005288 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 14:37:31.006273 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 14:37:31.006273 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 14:37:31.006273 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 14:37:31.006273 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 14:37:31.006273 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:37:31.006273 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:37:31.006273 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:37:31.006273 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:37:31.006273 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:37:31.006273 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:37:31.006273 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:37:31.006273 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application with Lock( Jul 26 14:37:31.006273 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:37:31.006273 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:37:31.006273 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:37:31.006273 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:37:31.007058 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:37:31.007058 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:37:31.007058 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:37:31.007058 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:37:31.007058 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 14:37:31.007058 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 14:37:31.007058 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 14:37:31.007058 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 14:37:31.007058 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 14:37:31.007058 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 14:37:31.007058 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 26 14:37:31.007058 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Jul 26 14:37:31.009075 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 88/164] 10.222.0.93 () {56 vars in 1099 bytes} [Tue Jul 26 14:37:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 589 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 14:37:31.013179 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3976d96c-3158-464a-9f4e-ddbc6b5b6c18 None None] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:31.013670 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3976d96c-3158-464a-9f4e-ddbc6b5b6c18 None None] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:31.014160 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3976d96c-3158-464a-9f4e-ddbc6b5b6c18 None None] PATH_INFO: `/` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:31.025808 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 89/165] 10.222.0.93 () {54 vars in 926 bytes} [Tue Jul 26 14:37:31 2022] GET /identity => generated 270 bytes in 17 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:37:31.029897 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3976d96c-3158-464a-9f4e-ddbc6b5b6c18 None None] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:37:31.250751 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:37:31.327133 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3976d96c-3158-464a-9f4e-ddbc6b5b6c18 None None] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:37:31.394892 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 77/166] 10.222.0.93 () {58 vars in 1282 bytes} [Tue Jul 26 14:37:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 1053 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 26 14:37:31.397363 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f19527-b6fb-467b-a282-195ec0cf2b6e None None] REQUEST_METHOD: `POST` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:31.398051 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f19527-b6fb-467b-a282-195ec0cf2b6e None None] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:31.400674 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f19527-b6fb-467b-a282-195ec0cf2b6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:31.412083 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:37:31.414750 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecc485c-65d0-48fe-b729-d0f7d9ecfc3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:37:31.416019 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecc485c-65d0-48fe-b729-d0f7d9ecfc3e None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:31.416303 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecc485c-65d0-48fe-b729-d0f7d9ecfc3e None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:31.416581 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecc485c-65d0-48fe-b729-d0f7d9ecfc3e None admin] PATH_INFO: `/v3/roles` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:31.417318 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecc485c-65d0-48fe-b729-d0f7d9ecfc3e None admin] RBAC: Adding query filter params (name=member) {{(pid=87056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:37:31.417624 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecc485c-65d0-48fe-b729-d0f7d9ecfc3e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:37:31.419092 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecc485c-65d0-48fe-b729-d0f7d9ecfc3e None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:37:31.438735 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.auth.core [None req-f9f19527-b6fb-467b-a282-195ec0cf2b6e None None] MFA Rules not processed for user `e5ef88cc058f425b882bcb87a1e1e75c`. Rule list: `[]` (Enabled: `True`). {{(pid=87055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:37:31.439953 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.fernet_utils [None req-f9f19527-b6fb-467b-a282-195ec0cf2b6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:37:31.444276 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 90/167] 10.222.0.93 () {56 vars in 1101 bytes} [Tue Jul 26 14:37:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 418 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:37:31.445583 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc8ae24-de58-4783-a20f-d216a0e85443 None None] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:31.445936 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc8ae24-de58-4783-a20f-d216a0e85443 None None] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:31.446180 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc8ae24-de58-4783-a20f-d216a0e85443 None None] PATH_INFO: `/` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:31.448690 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 91/168] 10.222.0.93 () {54 vars in 926 bytes} [Tue Jul 26 14:37:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:37:31.449488 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc8ae24-de58-4783-a20f-d216a0e85443 None None] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:37:31.589597 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 78/169] 10.222.0.93 () {58 vars in 1023 bytes} [Tue Jul 26 14:37:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 14:37:31.590469 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f19527-b6fb-467b-a282-195ec0cf2b6e None None] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:37:31.687263 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc8ae24-de58-4783-a20f-d216a0e85443 None None] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:37:31.767461 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65eb573f-e6f7-4310-9efb-482f212d451a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:37:31.768139 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65eb573f-e6f7-4310-9efb-482f212d451a None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:31.768421 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65eb573f-e6f7-4310-9efb-482f212d451a None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:31.768696 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65eb573f-e6f7-4310-9efb-482f212d451a None admin] PATH_INFO: `/v3/projects/798795388b0c46a3a4ae48ca79f5c6ce` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:31.770077 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65eb573f-e6f7-4310-9efb-482f212d451a None admin] RBAC: Authorizing `identity:get_project(project_id=798795388b0c46a3a4ae48ca79f5c6ce)` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:37:31.772598 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65eb573f-e6f7-4310-9efb-482f212d451a None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:37:31.775075 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 92/170] 10.222.0.93 () {56 vars in 1186 bytes} [Tue Jul 26 14:37:31 2022] GET /identity/v3/projects/798795388b0c46a3a4ae48ca79f5c6ce => generated 298 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:37:31.776449 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a4b836-845d-4cfc-a2b3-b8652da00a21 None None] REQUEST_METHOD: `POST` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:31.776746 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a4b836-845d-4cfc-a2b3-b8652da00a21 None None] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:31.777021 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a4b836-845d-4cfc-a2b3-b8652da00a21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:31.794373 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:37:31.802025 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.auth.core [None req-87a4b836-845d-4cfc-a2b3-b8652da00a21 None None] MFA Rules not processed for user `e5ef88cc058f425b882bcb87a1e1e75c`. Rule list: `[]` (Enabled: `True`). {{(pid=87056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:37:31.803665 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.fernet_utils [None req-87a4b836-845d-4cfc-a2b3-b8652da00a21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:37:31.825197 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f19527-b6fb-467b-a282-195ec0cf2b6e None None] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:37:31.878921 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:37:31.887179 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8df891-e1af-4a14-be64-58a490f8c22d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:37:31.887954 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8df891-e1af-4a14-be64-58a490f8c22d None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:31.888231 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8df891-e1af-4a14-be64-58a490f8c22d None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:31.888515 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8df891-e1af-4a14-be64-58a490f8c22d None admin] PATH_INFO: `/v3/users/7295436e2b73480da2d21e361333fbb8` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:31.890011 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8df891-e1af-4a14-be64-58a490f8c22d None admin] RBAC: Authorizing `identity:get_user(user_id=7295436e2b73480da2d21e361333fbb8)` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:37:31.891700 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8df891-e1af-4a14-be64-58a490f8c22d None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:37:31.893624 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 79/171] 10.222.0.93 () {56 vars in 1177 bytes} [Tue Jul 26 14:37:31 2022] GET /identity/v3/users/7295436e2b73480da2d21e361333fbb8 => generated 275 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:37:31.894222 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8df891-e1af-4a14-be64-58a490f8c22d None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:37:32.009575 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 93/172] 10.222.0.93 () {58 vars in 1023 bytes} [Tue Jul 26 14:37:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 14:37:32.011126 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a4b836-845d-4cfc-a2b3-b8652da00a21 None None] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:37:32.026622 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8df891-e1af-4a14-be64-58a490f8c22d None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:37:32.116329 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6143ecd3-d827-4371-a63f-e73ddd04490a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:37:32.117441 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6143ecd3-d827-4371-a63f-e73ddd04490a None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:32.117935 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6143ecd3-d827-4371-a63f-e73ddd04490a None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:32.119200 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6143ecd3-d827-4371-a63f-e73ddd04490a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:32.136741 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6143ecd3-d827-4371-a63f-e73ddd04490a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 14:37:32.143023 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application [None req-6143ecd3-d827-4371-a63f-e73ddd04490a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 14:37:32.143023 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:37:32.143023 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:37:32.143023 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:37:32.143023 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:37:32.143023 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:37:32.143023 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:37:32.143023 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:37:32.143023 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:37:32.143023 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:37:32.143023 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:37:32.143023 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:37:32.143023 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 14:37:32.143023 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 14:37:32.143023 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 14:37:32.143023 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 14:37:32.145178 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 14:37:32.145178 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 14:37:32.145178 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 14:37:32.145178 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 14:37:32.145178 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:37:32.145178 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:37:32.145178 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:37:32.145178 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:37:32.145178 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:37:32.145178 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:37:32.145178 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:37:32.145178 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application with Lock( Jul 26 14:37:32.145178 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:37:32.145178 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:37:32.145178 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:37:32.145178 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:37:32.147966 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:37:32.147966 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:37:32.147966 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:37:32.147966 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:37:32.147966 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 14:37:32.147966 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 14:37:32.147966 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 14:37:32.147966 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 14:37:32.147966 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 14:37:32.147966 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 14:37:32.147966 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 14:37:32.147966 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Jul 26 14:37:32.147966 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 80/173] 10.222.0.93 () {56 vars in 1096 bytes} [Tue Jul 26 14:37:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:37:32.147966 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6143ecd3-d827-4371-a63f-e73ddd04490a None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:37:32.219363 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:37:32.254532 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a4b836-845d-4cfc-a2b3-b8652da00a21 None None] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:37:32.267225 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6143ecd3-d827-4371-a63f-e73ddd04490a None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:37:32.309226 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5192a47-139d-4d1c-ad2a-ba6a22956821 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:37:32.310444 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5192a47-139d-4d1c-ad2a-ba6a22956821 None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:32.310803 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5192a47-139d-4d1c-ad2a-ba6a22956821 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:32.311153 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5192a47-139d-4d1c-ad2a-ba6a22956821 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:32.333922 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de860766-5701-4500-a089-2c9d6660aeda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:37:32.335185 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de860766-5701-4500-a089-2c9d6660aeda None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:32.335679 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de860766-5701-4500-a089-2c9d6660aeda None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:32.336167 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de860766-5701-4500-a089-2c9d6660aeda None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:32.338427 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de860766-5701-4500-a089-2c9d6660aeda None admin] RBAC: Adding query filter params (role.id=ef1a806f8d774452a6536b57a4670ceb, scope.project.id=798795388b0c46a3a4ae48ca79f5c6ce, user.id=7295436e2b73480da2d21e361333fbb8) {{(pid=87056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:37:32.339134 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de860766-5701-4500-a089-2c9d6660aeda None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:37:32.342225 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de860766-5701-4500-a089-2c9d6660aeda None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:37:32.348723 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:37:32.366500 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 94/174] 10.222.0.93 () {56 vars in 1374 bytes} [Tue Jul 26 14:37:32 2022] GET /identity/v3/role_assignments?user.id=7295436e2b73480da2d21e361333fbb8&scope.project.id=798795388b0c46a3a4ae48ca79f5c6ce&role.id=ef1a806f8d774452a6536b57a4670ceb => generated 608 bytes in 348 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:37:32.369830 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbda54e7-1d59-4aae-9e77-bc7f9dd1d4cc None None] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:32.370687 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbda54e7-1d59-4aae-9e77-bc7f9dd1d4cc None None] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:32.371380 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbda54e7-1d59-4aae-9e77-bc7f9dd1d4cc None None] PATH_INFO: `/` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:32.374562 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 95/175] 10.222.0.93 () {54 vars in 926 bytes} [Tue Jul 26 14:37:32 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:37:32.376468 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbda54e7-1d59-4aae-9e77-bc7f9dd1d4cc None None] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:37:32.401583 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5192a47-139d-4d1c-ad2a-ba6a22956821 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:37:32.403994 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5192a47-139d-4d1c-ad2a-ba6a22956821 None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:37:32.495606 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:37:32.583682 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 81/176] 10.222.0.93 () {58 vars in 1282 bytes} [Tue Jul 26 14:37:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 14:37:32.585105 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5192a47-139d-4d1c-ad2a-ba6a22956821 None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:37:32.634730 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbda54e7-1d59-4aae-9e77-bc7f9dd1d4cc None None] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:37:32.698367 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff005d13-3304-4163-87cd-9455711f9025 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:37:32.699140 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff005d13-3304-4163-87cd-9455711f9025 None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:32.699432 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff005d13-3304-4163-87cd-9455711f9025 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:32.699711 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff005d13-3304-4163-87cd-9455711f9025 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:32.714536 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff005d13-3304-4163-87cd-9455711f9025 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 14:37:32.719661 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application [None req-ff005d13-3304-4163-87cd-9455711f9025 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 14:37:32.719661 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:37:32.719661 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:37:32.719661 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:37:32.719661 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:37:32.719661 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:37:32.719661 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:37:32.719661 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:37:32.719661 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:37:32.719661 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:37:32.719661 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:37:32.719661 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:37:32.719661 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 14:37:32.719661 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 14:37:32.719661 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 14:37:32.719661 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 14:37:32.726828 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 14:37:32.726828 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 14:37:32.726828 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 14:37:32.726828 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 14:37:32.726828 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:37:32.726828 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:37:32.726828 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:37:32.726828 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:37:32.726828 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:37:32.726828 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:37:32.726828 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:37:32.726828 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application with Lock( Jul 26 14:37:32.726828 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:37:32.726828 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:37:32.726828 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:37:32.726828 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:37:32.729107 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:37:32.729107 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:37:32.729107 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:37:32.729107 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:37:32.729107 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 14:37:32.729107 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 14:37:32.729107 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 14:37:32.729107 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 14:37:32.729107 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 14:37:32.729107 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 14:37:32.729107 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 14:37:32.729107 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Jul 26 14:37:32.729107 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 96/177] 10.222.0.93 () {56 vars in 1096 bytes} [Tue Jul 26 14:37:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 345 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:37:32.729107 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3c1d9b-a1da-40f3-9605-93b625f7ad3b None None] REQUEST_METHOD: `POST` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:32.751206 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3c1d9b-a1da-40f3-9605-93b625f7ad3b None None] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:32.751206 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3c1d9b-a1da-40f3-9605-93b625f7ad3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:32.757442 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.auth.core [None req-4e3c1d9b-a1da-40f3-9605-93b625f7ad3b None None] MFA Rules not processed for user `e5ef88cc058f425b882bcb87a1e1e75c`. Rule list: `[]` (Enabled: `True`). {{(pid=87056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:37:32.757442 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.fernet_utils [None req-4e3c1d9b-a1da-40f3-9605-93b625f7ad3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:37:32.791874 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5192a47-139d-4d1c-ad2a-ba6a22956821 None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:37:32.845558 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935fab86-c0eb-4bb9-9b17-013c803b060a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:37:32.846290 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935fab86-c0eb-4bb9-9b17-013c803b060a None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:32.846548 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935fab86-c0eb-4bb9-9b17-013c803b060a None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:32.847089 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935fab86-c0eb-4bb9-9b17-013c803b060a None admin] PATH_INFO: `/v3/roles` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:32.847540 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935fab86-c0eb-4bb9-9b17-013c803b060a None admin] RBAC: Adding query filter params (name=admin) {{(pid=87055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:37:32.847856 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935fab86-c0eb-4bb9-9b17-013c803b060a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:37:32.849300 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935fab86-c0eb-4bb9-9b17-013c803b060a None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:37:32.864909 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 82/178] 10.222.0.93 () {56 vars in 1099 bytes} [Tue Jul 26 14:37:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:37:32.864909 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e05c8e-bfed-4a91-b793-d6fd6762e26f None None] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:32.864909 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e05c8e-bfed-4a91-b793-d6fd6762e26f None None] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:32.864909 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e05c8e-bfed-4a91-b793-d6fd6762e26f None None] PATH_INFO: `/` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:32.864909 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 83/179] 10.222.0.93 () {54 vars in 926 bytes} [Tue Jul 26 14:37:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:37:32.867479 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e05c8e-bfed-4a91-b793-d6fd6762e26f None None] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:37:32.873940 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:37:32.902278 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 97/180] 10.222.0.93 () {58 vars in 1023 bytes} [Tue Jul 26 14:37:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 14:37:32.902278 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3c1d9b-a1da-40f3-9605-93b625f7ad3b None None] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:37:32.923274 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:37:33.018774 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e05c8e-bfed-4a91-b793-d6fd6762e26f None None] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:37:33.027138 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3c1d9b-a1da-40f3-9605-93b625f7ad3b None None] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:37:33.069653 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d97f833-bf13-4a52-b466-7e57406a74a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:37:33.070405 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d97f833-bf13-4a52-b466-7e57406a74a6 None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:33.070604 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d97f833-bf13-4a52-b466-7e57406a74a6 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:33.070951 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d97f833-bf13-4a52-b466-7e57406a74a6 None admin] PATH_INFO: `/v3/projects/507ce424ca774469b12dd7bbc4b4c17e` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:33.072833 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d97f833-bf13-4a52-b466-7e57406a74a6 None admin] RBAC: Authorizing `identity:get_project(project_id=507ce424ca774469b12dd7bbc4b4c17e)` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:37:33.074335 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d97f833-bf13-4a52-b466-7e57406a74a6 None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:37:33.074964 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a77f741-800e-44c2-b59c-7ef3e0ce4f96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:37:33.083486 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 84/181] 10.222.0.93 () {56 vars in 1186 bytes} [Tue Jul 26 14:37:32 2022] GET /identity/v3/projects/507ce424ca774469b12dd7bbc4b4c17e => generated 312 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:37:33.083739 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a77f741-800e-44c2-b59c-7ef3e0ce4f96 None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:33.083739 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a77f741-800e-44c2-b59c-7ef3e0ce4f96 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:33.084017 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d97f833-bf13-4a52-b466-7e57406a74a6 None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:37:33.084162 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a77f741-800e-44c2-b59c-7ef3e0ce4f96 None admin] PATH_INFO: `/v3/roles` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:33.084162 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a77f741-800e-44c2-b59c-7ef3e0ce4f96 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:37:33.084162 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a77f741-800e-44c2-b59c-7ef3e0ce4f96 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:37:33.084162 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a77f741-800e-44c2-b59c-7ef3e0ce4f96 None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:37:33.100879 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 98/182] 10.222.0.93 () {56 vars in 1099 bytes} [Tue Jul 26 14:37:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:37:33.103485 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff4430f-90d5-4318-9d7a-f34f2fc406b5 None None] REQUEST_METHOD: `POST` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:33.104617 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff4430f-90d5-4318-9d7a-f34f2fc406b5 None None] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:33.105224 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff4430f-90d5-4318-9d7a-f34f2fc406b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:33.135505 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.auth.core [None req-aff4430f-90d5-4318-9d7a-f34f2fc406b5 None None] MFA Rules not processed for user `e5ef88cc058f425b882bcb87a1e1e75c`. Rule list: `[]` (Enabled: `True`). {{(pid=87056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:37:33.137660 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.fernet_utils [None req-aff4430f-90d5-4318-9d7a-f34f2fc406b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:37:33.232706 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:37:33.239004 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:37:33.255103 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 99/183] 10.222.0.93 () {58 vars in 1023 bytes} [Tue Jul 26 14:37:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 14:37:33.255985 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff4430f-90d5-4318-9d7a-f34f2fc406b5 None None] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:37:33.256820 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d97f833-bf13-4a52-b466-7e57406a74a6 None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:37:33.319406 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9a6944-53d5-4f48-bacc-0af43f01a930 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:37:33.320250 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9a6944-53d5-4f48-bacc-0af43f01a930 None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:33.320663 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9a6944-53d5-4f48-bacc-0af43f01a930 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:33.321033 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9a6944-53d5-4f48-bacc-0af43f01a930 None admin] PATH_INFO: `/v3/users/e5ef88cc058f425b882bcb87a1e1e75c` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:33.323096 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9a6944-53d5-4f48-bacc-0af43f01a930 None admin] RBAC: Authorizing `identity:get_user(user_id=e5ef88cc058f425b882bcb87a1e1e75c)` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:37:33.324697 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9a6944-53d5-4f48-bacc-0af43f01a930 None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:37:33.326440 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 85/184] 10.222.0.93 () {56 vars in 1177 bytes} [Tue Jul 26 14:37:33 2022] GET /identity/v3/users/e5ef88cc058f425b882bcb87a1e1e75c => generated 247 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:37:33.327267 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9a6944-53d5-4f48-bacc-0af43f01a930 None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:37:33.396100 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff4430f-90d5-4318-9d7a-f34f2fc406b5 None None] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:37:33.438703 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7333333a-81dc-4789-bbb8-8d9700fee82d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:37:33.439731 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7333333a-81dc-4789-bbb8-8d9700fee82d None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:33.440140 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7333333a-81dc-4789-bbb8-8d9700fee82d None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:33.440500 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7333333a-81dc-4789-bbb8-8d9700fee82d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:33.457643 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7333333a-81dc-4789-bbb8-8d9700fee82d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 14:37:33.459176 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9a6944-53d5-4f48-bacc-0af43f01a930 None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:37:33.463550 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application [None req-7333333a-81dc-4789-bbb8-8d9700fee82d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 14:37:33.463550 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:37:33.463550 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:37:33.463550 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:37:33.463550 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:37:33.463550 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:37:33.463550 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:37:33.463550 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:37:33.463550 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:37:33.463550 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:37:33.463550 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:37:33.463550 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:37:33.463550 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 14:37:33.463550 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 14:37:33.463550 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 14:37:33.463550 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 14:37:33.464531 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 14:37:33.464531 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 14:37:33.464531 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 14:37:33.464531 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 14:37:33.464531 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:37:33.464531 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:37:33.464531 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:37:33.464531 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:37:33.464531 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:37:33.464531 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:37:33.464531 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:37:33.464531 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application with Lock( Jul 26 14:37:33.464531 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:37:33.464531 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:37:33.464531 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:37:33.464531 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:37:33.465311 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:37:33.465311 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:37:33.465311 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:37:33.465311 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:37:33.465311 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 14:37:33.465311 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 14:37:33.465311 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 14:37:33.465311 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 14:37:33.465311 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 14:37:33.465311 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 14:37:33.465311 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 14:37:33.465311 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Jul 26 14:37:33.465311 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 100/185] 10.222.0.93 () {56 vars in 1114 bytes} [Tue Jul 26 14:37:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:37:33.465952 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7333333a-81dc-4789-bbb8-8d9700fee82d None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:37:33.512372 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c057ca72-e5e0-4845-8d3f-57d2a19abf67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:37:33.513157 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c057ca72-e5e0-4845-8d3f-57d2a19abf67 None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:33.513612 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c057ca72-e5e0-4845-8d3f-57d2a19abf67 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:33.514065 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c057ca72-e5e0-4845-8d3f-57d2a19abf67 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:33.515510 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c057ca72-e5e0-4845-8d3f-57d2a19abf67 None admin] RBAC: Adding query filter params (role.id=8b8a4a451dc84c17bba824b2ff9cc4fe, scope.project.id=507ce424ca774469b12dd7bbc4b4c17e, user.id=7295436e2b73480da2d21e361333fbb8) {{(pid=87055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:37:33.516022 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c057ca72-e5e0-4845-8d3f-57d2a19abf67 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:37:33.518456 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c057ca72-e5e0-4845-8d3f-57d2a19abf67 None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:37:33.527625 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 86/186] 10.222.0.93 () {56 vars in 1374 bytes} [Tue Jul 26 14:37:33 2022] GET /identity/v3/role_assignments?user.id=7295436e2b73480da2d21e361333fbb8&scope.project.id=507ce424ca774469b12dd7bbc4b4c17e&role.id=8b8a4a451dc84c17bba824b2ff9cc4fe => generated 608 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:37:33.529801 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db99954-795e-475f-af64-177936d2b9d3 None None] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:33.530365 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db99954-795e-475f-af64-177936d2b9d3 None None] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:33.530847 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db99954-795e-475f-af64-177936d2b9d3 None None] PATH_INFO: `/` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:33.533522 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 87/187] 10.222.0.93 () {54 vars in 926 bytes} [Tue Jul 26 14:37:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:37:33.534835 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db99954-795e-475f-af64-177936d2b9d3 None None] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:37:33.544733 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:37:33.572228 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:37:33.631022 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7333333a-81dc-4789-bbb8-8d9700fee82d None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:37:33.685118 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1edfb38-a93a-4848-9a16-d3127c9136b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:37:33.685787 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1edfb38-a93a-4848-9a16-d3127c9136b4 None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:33.686071 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1edfb38-a93a-4848-9a16-d3127c9136b4 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:33.686419 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1edfb38-a93a-4848-9a16-d3127c9136b4 None admin] PATH_INFO: `/v3/users/1561cf57fa494e5ab6566a7df55ad58e` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:33.704177 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db99954-795e-475f-af64-177936d2b9d3 None None] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:37:33.707407 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1edfb38-a93a-4848-9a16-d3127c9136b4 None admin] RBAC: Authorizing `identity:get_user(user_id=1561cf57fa494e5ab6566a7df55ad58e)` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:37:33.708961 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1edfb38-a93a-4848-9a16-d3127c9136b4 None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:37:33.719937 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 101/188] 10.222.0.93 () {56 vars in 1177 bytes} [Tue Jul 26 14:37:33 2022] GET /identity/v3/users/1561cf57fa494e5ab6566a7df55ad58e => generated 283 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:37:33.719937 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1edfb38-a93a-4848-9a16-d3127c9136b4 None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:37:33.766407 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bd8730-b84a-4b22-bde6-687462e77ebc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:37:33.767439 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bd8730-b84a-4b22-bde6-687462e77ebc None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:33.767887 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bd8730-b84a-4b22-bde6-687462e77ebc None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:33.768338 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bd8730-b84a-4b22-bde6-687462e77ebc None admin] PATH_INFO: `/v3/domains/default` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:33.770495 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bd8730-b84a-4b22-bde6-687462e77ebc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:37:33.772494 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bd8730-b84a-4b22-bde6-687462e77ebc None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:37:33.782149 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 88/189] 10.222.0.93 () {56 vars in 1108 bytes} [Tue Jul 26 14:37:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:37:33.782149 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bd8730-b84a-4b22-bde6-687462e77ebc None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:37:33.894967 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:37:33.900210 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1edfb38-a93a-4848-9a16-d3127c9136b4 None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:37:33.941006 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:37:33.951027 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d73425a-518d-42f2-9f03-f63fbd0086cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:37:33.951784 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d73425a-518d-42f2-9f03-f63fbd0086cc None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:33.952190 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d73425a-518d-42f2-9f03-f63fbd0086cc None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:33.952554 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d73425a-518d-42f2-9f03-f63fbd0086cc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:33.953804 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bd8730-b84a-4b22-bde6-687462e77ebc None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:37:33.997023 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a00aef-a023-428e-a15f-d21cc4e38309 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:37:33.997671 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a00aef-a023-428e-a15f-d21cc4e38309 None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:33.997961 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a00aef-a023-428e-a15f-d21cc4e38309 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:33.998287 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a00aef-a023-428e-a15f-d21cc4e38309 None admin] PATH_INFO: `/v3/roles` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:33.999007 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a00aef-a023-428e-a15f-d21cc4e38309 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:37:33.999319 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a00aef-a023-428e-a15f-d21cc4e38309 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:37:34.000741 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a00aef-a023-428e-a15f-d21cc4e38309 None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:37:34.010950 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 89/190] 10.222.0.93 () {56 vars in 1111 bytes} [Tue Jul 26 14:37:33 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:37:34.010950 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288fe121-9392-49ba-9168-587ff86cd690 None None] REQUEST_METHOD: `POST` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:34.010950 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288fe121-9392-49ba-9168-587ff86cd690 None None] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:34.010950 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288fe121-9392-49ba-9168-587ff86cd690 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:34.033632 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.auth.core [None req-288fe121-9392-49ba-9168-587ff86cd690 None None] MFA Rules not processed for user `e5ef88cc058f425b882bcb87a1e1e75c`. Rule list: `[]` (Enabled: `True`). {{(pid=87055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:37:34.034918 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.fernet_utils [None req-288fe121-9392-49ba-9168-587ff86cd690 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:37:34.061383 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d73425a-518d-42f2-9f03-f63fbd0086cc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:37:34.064230 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d73425a-518d-42f2-9f03-f63fbd0086cc None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:37:34.112785 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 90/191] 10.222.0.93 () {58 vars in 1023 bytes} [Tue Jul 26 14:37:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 14:37:34.114094 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288fe121-9392-49ba-9168-587ff86cd690 None None] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:37:34.232949 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:37:34.238610 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 102/192] 10.222.0.93 () {58 vars in 1282 bytes} [Tue Jul 26 14:37:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 527 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 14:37:34.240050 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d73425a-518d-42f2-9f03-f63fbd0086cc None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:37:34.251527 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:37:34.284446 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288fe121-9392-49ba-9168-587ff86cd690 None None] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:37:34.343442 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b892971e-95a6-4a25-a5fa-fd0bbd9fc71e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:37:34.344668 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b892971e-95a6-4a25-a5fa-fd0bbd9fc71e None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:34.345249 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b892971e-95a6-4a25-a5fa-fd0bbd9fc71e None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:34.345876 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b892971e-95a6-4a25-a5fa-fd0bbd9fc71e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:34.391870 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d73425a-518d-42f2-9f03-f63fbd0086cc None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:37:34.432604 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b892971e-95a6-4a25-a5fa-fd0bbd9fc71e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:37:34.434152 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b892971e-95a6-4a25-a5fa-fd0bbd9fc71e None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:37:34.448792 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc240e16-ac1d-4645-90c9-d707190c462f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:37:34.449744 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc240e16-ac1d-4645-90c9-d707190c462f None admin] REQUEST_METHOD: `POST` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:34.450197 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc240e16-ac1d-4645-90c9-d707190c462f None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:34.450692 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc240e16-ac1d-4645-90c9-d707190c462f None admin] PATH_INFO: `/v3/users` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:34.451943 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc240e16-ac1d-4645-90c9-d707190c462f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:37:34.454809 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc240e16-ac1d-4645-90c9-d707190c462f None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:37:34.534565 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:37:34.555258 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 91/193] 10.222.0.93 () {58 vars in 1282 bytes} [Tue Jul 26 14:37:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 14:37:34.556975 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b892971e-95a6-4a25-a5fa-fd0bbd9fc71e None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:37:34.594276 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 103/194] 10.222.0.93 () {60 vars in 1132 bytes} [Tue Jul 26 14:37:34 2022] POST /identity/v3/users => generated 297 bytes in 355 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 14:37:34.595724 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc240e16-ac1d-4645-90c9-d707190c462f None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:37:34.722428 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b892971e-95a6-4a25-a5fa-fd0bbd9fc71e None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:37:34.728917 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:37:34.777187 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e163c7f-bfa4-4364-bba9-6b7dec88536d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:37:34.778552 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e163c7f-bfa4-4364-bba9-6b7dec88536d None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:34.778817 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e163c7f-bfa4-4364-bba9-6b7dec88536d None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:34.779070 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e163c7f-bfa4-4364-bba9-6b7dec88536d None admin] PATH_INFO: `/v3/users/1561cf57fa494e5ab6566a7df55ad58e` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:34.780755 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e163c7f-bfa4-4364-bba9-6b7dec88536d None admin] RBAC: Authorizing `identity:get_user(user_id=1561cf57fa494e5ab6566a7df55ad58e)` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:37:34.783066 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e163c7f-bfa4-4364-bba9-6b7dec88536d None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:37:34.785892 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 92/195] 10.222.0.93 () {56 vars in 1177 bytes} [Tue Jul 26 14:37:34 2022] GET /identity/v3/users/1561cf57fa494e5ab6566a7df55ad58e => generated 283 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:37:34.787704 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e163c7f-bfa4-4364-bba9-6b7dec88536d None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:37:34.813757 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc240e16-ac1d-4645-90c9-d707190c462f None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:37:34.872551 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07124b2a-6464-4d10-b0fe-002808e9ee88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:37:34.873106 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07124b2a-6464-4d10-b0fe-002808e9ee88 None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:34.873550 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07124b2a-6464-4d10-b0fe-002808e9ee88 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:34.874028 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07124b2a-6464-4d10-b0fe-002808e9ee88 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:34.892565 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07124b2a-6464-4d10-b0fe-002808e9ee88 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 14:37:34.896661 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:37:34.900892 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application [None req-07124b2a-6464-4d10-b0fe-002808e9ee88 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 26 14:37:34.900892 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:37:34.900892 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:37:34.900892 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:37:34.900892 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:37:34.900892 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:37:34.900892 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:37:34.900892 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:37:34.900892 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:37:34.900892 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:37:34.900892 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:37:34.900892 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:37:34.900892 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 14:37:34.900892 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 14:37:34.900892 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 14:37:34.900892 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 14:37:34.910986 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 14:37:34.910986 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 14:37:34.910986 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 14:37:34.910986 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 14:37:34.910986 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:37:34.910986 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:37:34.910986 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:37:34.910986 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:37:34.910986 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:37:34.910986 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:37:34.910986 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:37:34.910986 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application with Lock( Jul 26 14:37:34.910986 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:37:34.910986 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:37:34.910986 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:37:34.910986 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:37:34.912413 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:37:34.912413 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:37:34.912413 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:37:34.912413 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:37:34.912413 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 14:37:34.912413 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 14:37:34.912413 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 14:37:34.912413 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 14:37:34.912413 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 14:37:34.912413 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 14:37:34.912413 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 26 14:37:34.912413 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Jul 26 14:37:34.912413 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 104/196] 10.222.0.93 () {56 vars in 1099 bytes} [Tue Jul 26 14:37:34 2022] GET /identity/v3/roles/reader => generated 84 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:37:34.912413 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07124b2a-6464-4d10-b0fe-002808e9ee88 None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:37:35.013452 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e163c7f-bfa4-4364-bba9-6b7dec88536d None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:37:35.084787 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8c5cc3-9702-411b-b078-343891aaeb33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:37:35.085761 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8c5cc3-9702-411b-b078-343891aaeb33 None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:35.086286 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8c5cc3-9702-411b-b078-343891aaeb33 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:35.087295 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8c5cc3-9702-411b-b078-343891aaeb33 None admin] PATH_INFO: `/v3/projects/798795388b0c46a3a4ae48ca79f5c6ce` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:35.089549 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8c5cc3-9702-411b-b078-343891aaeb33 None admin] RBAC: Authorizing `identity:get_project(project_id=798795388b0c46a3a4ae48ca79f5c6ce)` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:37:35.092296 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8c5cc3-9702-411b-b078-343891aaeb33 None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:37:35.095679 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 93/197] 10.222.0.93 () {56 vars in 1186 bytes} [Tue Jul 26 14:37:34 2022] GET /identity/v3/projects/798795388b0c46a3a4ae48ca79f5c6ce => generated 298 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:37:35.097434 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8c5cc3-9702-411b-b078-343891aaeb33 None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:37:35.115082 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07124b2a-6464-4d10-b0fe-002808e9ee88 None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:37:35.157082 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:37:35.189146 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a891918-1e70-4657-960e-8283b16194b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:37:35.190218 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a891918-1e70-4657-960e-8283b16194b9 None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:35.190743 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a891918-1e70-4657-960e-8283b16194b9 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:35.191284 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a891918-1e70-4657-960e-8283b16194b9 None admin] PATH_INFO: `/v3/projects/223cfb51fde24882a520cb183c0f36f8` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:35.194570 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a891918-1e70-4657-960e-8283b16194b9 None admin] RBAC: Authorizing `identity:get_project(project_id=223cfb51fde24882a520cb183c0f36f8)` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:37:35.199025 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a891918-1e70-4657-960e-8283b16194b9 None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:37:35.203217 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 105/198] 10.222.0.93 () {56 vars in 1186 bytes} [Tue Jul 26 14:37:34 2022] GET /identity/v3/projects/223cfb51fde24882a520cb183c0f36f8 => generated 302 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:37:35.205340 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a891918-1e70-4657-960e-8283b16194b9 None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:37:35.330898 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8c5cc3-9702-411b-b078-343891aaeb33 None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:37:35.371193 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:37:35.405371 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491dca4d-0bc7-4943-ae4d-5e21268f1e13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:37:35.407313 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491dca4d-0bc7-4943-ae4d-5e21268f1e13 None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:35.408457 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491dca4d-0bc7-4943-ae4d-5e21268f1e13 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:35.409886 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491dca4d-0bc7-4943-ae4d-5e21268f1e13 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:35.437963 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a891918-1e70-4657-960e-8283b16194b9 None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:37:35.536633 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5b93ce-08f9-4119-b046-c53535e62e6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:37:35.538190 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5b93ce-08f9-4119-b046-c53535e62e6b None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:35.539043 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5b93ce-08f9-4119-b046-c53535e62e6b None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:35.539811 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5b93ce-08f9-4119-b046-c53535e62e6b None admin] PATH_INFO: `/v3/roles` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:35.542100 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5b93ce-08f9-4119-b046-c53535e62e6b None admin] RBAC: Adding query filter params (name=reader) {{(pid=87056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:37:35.542965 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5b93ce-08f9-4119-b046-c53535e62e6b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:37:35.545892 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5b93ce-08f9-4119-b046-c53535e62e6b None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:37:35.560175 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491dca4d-0bc7-4943-ae4d-5e21268f1e13 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:37:35.561787 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491dca4d-0bc7-4943-ae4d-5e21268f1e13 None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:37:35.563505 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 106/199] 10.222.0.93 () {56 vars in 1101 bytes} [Tue Jul 26 14:37:35 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 360 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:37:35.565299 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5b93ce-08f9-4119-b046-c53535e62e6b None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:37:35.664599 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:37:35.698681 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 94/200] 10.222.0.93 () {58 vars in 1282 bytes} [Tue Jul 26 14:37:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 599 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 14:37:35.698681 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491dca4d-0bc7-4943-ae4d-5e21268f1e13 None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:37:35.719669 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:37:35.776126 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5b93ce-08f9-4119-b046-c53535e62e6b None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:37:35.820965 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491dca4d-0bc7-4943-ae4d-5e21268f1e13 None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:37:35.845426 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e8a460-9f2b-4ac0-b881-4abb2ad0ce5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:37:35.846836 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e8a460-9f2b-4ac0-b881-4abb2ad0ce5e None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:35.847054 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e8a460-9f2b-4ac0-b881-4abb2ad0ce5e None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:35.847550 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e8a460-9f2b-4ac0-b881-4abb2ad0ce5e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:35.849304 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e8a460-9f2b-4ac0-b881-4abb2ad0ce5e None admin] RBAC: Adding query filter params (role.id=94e105ff8ee4486abd501415cc05ba38, scope.project.id=798795388b0c46a3a4ae48ca79f5c6ce, user.id=e5ef88cc058f425b882bcb87a1e1e75c) {{(pid=87056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:37:35.849840 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e8a460-9f2b-4ac0-b881-4abb2ad0ce5e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:37:35.853370 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e8a460-9f2b-4ac0-b881-4abb2ad0ce5e None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:37:35.866285 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ad9eaa-5a1a-4a9a-a700-2f4333c9024b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:37:35.867188 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ad9eaa-5a1a-4a9a-a700-2f4333c9024b None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:35.867611 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ad9eaa-5a1a-4a9a-a700-2f4333c9024b None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:35.868632 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ad9eaa-5a1a-4a9a-a700-2f4333c9024b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:35.870075 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ad9eaa-5a1a-4a9a-a700-2f4333c9024b None admin] RBAC: Adding query filter params (role.id=94e105ff8ee4486abd501415cc05ba38, scope.project.id=223cfb51fde24882a520cb183c0f36f8, user.id=1561cf57fa494e5ab6566a7df55ad58e) {{(pid=87055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:37:35.870568 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ad9eaa-5a1a-4a9a-a700-2f4333c9024b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:37:35.870738 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 107/201] 10.222.0.93 () {56 vars in 1374 bytes} [Tue Jul 26 14:37:35 2022] GET /identity/v3/role_assignments?user.id=e5ef88cc058f425b882bcb87a1e1e75c&scope.project.id=798795388b0c46a3a4ae48ca79f5c6ce&role.id=94e105ff8ee4486abd501415cc05ba38 => generated 608 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:37:35.872331 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e8a460-9f2b-4ac0-b881-4abb2ad0ce5e None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:37:35.872504 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ad9eaa-5a1a-4a9a-a700-2f4333c9024b None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:37:35.879724 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 95/202] 10.222.0.93 () {56 vars in 1374 bytes} [Tue Jul 26 14:37:35 2022] GET /identity/v3/role_assignments?user.id=1561cf57fa494e5ab6566a7df55ad58e&scope.project.id=223cfb51fde24882a520cb183c0f36f8&role.id=94e105ff8ee4486abd501415cc05ba38 => generated 259 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:37:35.881039 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ad9eaa-5a1a-4a9a-a700-2f4333c9024b None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:37:35.996485 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:37:36.045755 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ad9eaa-5a1a-4a9a-a700-2f4333c9024b None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:37:36.129760 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ab10ed-3f13-497f-832a-d2a4a639410b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:37:36.130789 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ab10ed-3f13-497f-832a-d2a4a639410b None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:36.131267 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ab10ed-3f13-497f-832a-d2a4a639410b None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:36.131718 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ab10ed-3f13-497f-832a-d2a4a639410b None admin] PATH_INFO: `/v3/projects/223cfb51fde24882a520cb183c0f36f8` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:36.136143 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ab10ed-3f13-497f-832a-d2a4a639410b None admin] RBAC: Authorizing `identity:get_project(project_id=223cfb51fde24882a520cb183c0f36f8)` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:37:36.138009 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ab10ed-3f13-497f-832a-d2a4a639410b None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:37:36.143087 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 96/203] 10.222.0.93 () {56 vars in 1186 bytes} [Tue Jul 26 14:37:35 2022] GET /identity/v3/projects/223cfb51fde24882a520cb183c0f36f8 => generated 302 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:37:36.152970 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e8a460-9f2b-4ac0-b881-4abb2ad0ce5e None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:37:36.157338 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ab10ed-3f13-497f-832a-d2a4a639410b None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:37:36.185990 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:37:36.247350 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50317ac-34c5-40d5-944c-a84e65177400 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:37:36.247927 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50317ac-34c5-40d5-944c-a84e65177400 None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:36.248235 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50317ac-34c5-40d5-944c-a84e65177400 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:36.248613 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50317ac-34c5-40d5-944c-a84e65177400 None admin] PATH_INFO: `/v3/users/13cbdb2b220f42cd8737957639a98fe6` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:36.250311 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50317ac-34c5-40d5-944c-a84e65177400 None admin] RBAC: Authorizing `identity:get_user(user_id=13cbdb2b220f42cd8737957639a98fe6)` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:37:36.251807 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50317ac-34c5-40d5-944c-a84e65177400 None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:37:36.253827 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 108/204] 10.222.0.93 () {56 vars in 1177 bytes} [Tue Jul 26 14:37:35 2022] GET /identity/v3/users/13cbdb2b220f42cd8737957639a98fe6 => generated 289 bytes in 382 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:37:36.264609 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50317ac-34c5-40d5-944c-a84e65177400 None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:37:36.328950 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ab10ed-3f13-497f-832a-d2a4a639410b None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:37:36.396560 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f14f35-4c21-4920-84b5-d43e97e7db63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:37:36.397311 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f14f35-4c21-4920-84b5-d43e97e7db63 None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:36.397524 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f14f35-4c21-4920-84b5-d43e97e7db63 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:36.397740 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f14f35-4c21-4920-84b5-d43e97e7db63 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:36.398608 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f14f35-4c21-4920-84b5-d43e97e7db63 None admin] RBAC: Adding query filter params (role.id=ef1a806f8d774452a6536b57a4670ceb, scope.project.id=223cfb51fde24882a520cb183c0f36f8, user.id=1561cf57fa494e5ab6566a7df55ad58e) {{(pid=87055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:37:36.398956 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f14f35-4c21-4920-84b5-d43e97e7db63 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:37:36.401056 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f14f35-4c21-4920-84b5-d43e97e7db63 None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:37:36.416240 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 97/205] 10.222.0.93 () {56 vars in 1374 bytes} [Tue Jul 26 14:37:36 2022] GET /identity/v3/role_assignments?user.id=1561cf57fa494e5ab6566a7df55ad58e&scope.project.id=223cfb51fde24882a520cb183c0f36f8&role.id=ef1a806f8d774452a6536b57a4670ceb => generated 259 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:37:36.499546 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50317ac-34c5-40d5-944c-a84e65177400 None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:37:36.556295 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183e5a15-b5c4-4267-b3ba-0843ab507787 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:37:36.556967 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183e5a15-b5c4-4267-b3ba-0843ab507787 None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:36.557254 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183e5a15-b5c4-4267-b3ba-0843ab507787 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:36.557532 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183e5a15-b5c4-4267-b3ba-0843ab507787 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:36.640486 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:37:36.670174 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183e5a15-b5c4-4267-b3ba-0843ab507787 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:37:36.672175 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183e5a15-b5c4-4267-b3ba-0843ab507787 None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:37:36.831638 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 109/206] 10.222.0.93 () {58 vars in 1282 bytes} [Tue Jul 26 14:37:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 568 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 14:37:36.841082 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f14f35-4c21-4920-84b5-d43e97e7db63 None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:37:36.879910 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:37:37.005046 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f14f35-4c21-4920-84b5-d43e97e7db63 None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:37:37.060075 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde9da34-b448-4f6d-98b9-a4c116dc376d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:37:37.060750 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde9da34-b448-4f6d-98b9-a4c116dc376d None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:37.061035 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde9da34-b448-4f6d-98b9-a4c116dc376d None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:37.061314 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde9da34-b448-4f6d-98b9-a4c116dc376d None admin] PATH_INFO: `/v3/projects/798795388b0c46a3a4ae48ca79f5c6ce` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:37.067134 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde9da34-b448-4f6d-98b9-a4c116dc376d None admin] RBAC: Authorizing `identity:get_project(project_id=798795388b0c46a3a4ae48ca79f5c6ce)` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:37:37.068635 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde9da34-b448-4f6d-98b9-a4c116dc376d None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:37:37.070657 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 98/207] 10.222.0.93 () {56 vars in 1186 bytes} [Tue Jul 26 14:37:36 2022] GET /identity/v3/projects/798795388b0c46a3a4ae48ca79f5c6ce => generated 298 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:37:37.080107 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183e5a15-b5c4-4267-b3ba-0843ab507787 None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:37:37.227036 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:37:37.255329 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183e5a15-b5c4-4267-b3ba-0843ab507787 None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:37:37.315062 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c36710c-579e-4634-b8a9-67de8c63142f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:37:37.315720 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c36710c-579e-4634-b8a9-67de8c63142f None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:37.316007 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c36710c-579e-4634-b8a9-67de8c63142f None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:37.316287 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c36710c-579e-4634-b8a9-67de8c63142f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:37.317121 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c36710c-579e-4634-b8a9-67de8c63142f None admin] RBAC: Adding query filter params (role.id=8b206d8d963645f6bd492384b6c5d39f, scope.project.id=798795388b0c46a3a4ae48ca79f5c6ce, user.id=13cbdb2b220f42cd8737957639a98fe6) {{(pid=87056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:37:37.317438 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c36710c-579e-4634-b8a9-67de8c63142f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:37:37.318981 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c36710c-579e-4634-b8a9-67de8c63142f None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:37:37.327619 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 110/208] 10.222.0.93 () {56 vars in 1374 bytes} [Tue Jul 26 14:37:37 2022] GET /identity/v3/role_assignments?user.id=13cbdb2b220f42cd8737957639a98fe6&scope.project.id=798795388b0c46a3a4ae48ca79f5c6ce&role.id=8b206d8d963645f6bd492384b6c5d39f => generated 608 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:37:37.454859 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff37b6f4-a312-4877-8862-ac37f8a41eb7 None None] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:37.455583 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff37b6f4-a312-4877-8862-ac37f8a41eb7 None None] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:37.455583 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff37b6f4-a312-4877-8862-ac37f8a41eb7 None None] PATH_INFO: `/` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:37.457448 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 99/209] 10.222.0.93 () {54 vars in 926 bytes} [Tue Jul 26 14:37:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:37:37.463588 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1feb05-e48d-410c-85cb-564182b37375 None None] REQUEST_METHOD: `POST` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:37.463995 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1feb05-e48d-410c-85cb-564182b37375 None None] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:37.464137 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1feb05-e48d-410c-85cb-564182b37375 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:37.492401 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.auth.core [None req-5a1feb05-e48d-410c-85cb-564182b37375 None None] MFA Rules not processed for user `e5ef88cc058f425b882bcb87a1e1e75c`. Rule list: `[]` (Enabled: `True`). {{(pid=87056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:37:37.494316 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.fernet_utils [None req-5a1feb05-e48d-410c-85cb-564182b37375 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:37:37.607057 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 111/210] 10.222.0.93 () {58 vars in 1023 bytes} [Tue Jul 26 14:37:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 14:37:37.631595 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff37b6f4-a312-4877-8862-ac37f8a41eb7 None None] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:37:37.740892 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:37:37.778311 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff37b6f4-a312-4877-8862-ac37f8a41eb7 None None] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:37:37.863944 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11543500-30ee-4e19-b176-7f1e3afad5c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:37:37.865056 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11543500-30ee-4e19-b176-7f1e3afad5c8 None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:37.865544 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11543500-30ee-4e19-b176-7f1e3afad5c8 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:37.866037 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11543500-30ee-4e19-b176-7f1e3afad5c8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:37.889361 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11543500-30ee-4e19-b176-7f1e3afad5c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 14:37:37.903915 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application [None req-11543500-30ee-4e19-b176-7f1e3afad5c8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 26 14:37:37.903915 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:37:37.903915 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:37:37.903915 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:37:37.903915 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:37:37.903915 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:37:37.903915 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:37:37.903915 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:37:37.903915 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:37:37.903915 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:37:37.903915 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:37:37.903915 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:37:37.903915 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 14:37:37.903915 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 14:37:37.903915 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 14:37:37.903915 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 14:37:37.904845 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 14:37:37.904845 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 14:37:37.904845 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 14:37:37.904845 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 14:37:37.904845 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:37:37.904845 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:37:37.904845 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:37:37.904845 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:37:37.904845 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:37:37.904845 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:37:37.904845 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:37:37.904845 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application with Lock( Jul 26 14:37:37.904845 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:37:37.904845 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:37:37.904845 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:37:37.904845 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:37:37.905619 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:37:37.905619 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:37:37.905619 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:37:37.905619 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:37:37.905619 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 14:37:37.905619 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 14:37:37.905619 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 14:37:37.905619 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 14:37:37.905619 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 14:37:37.905619 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 14:37:37.905619 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 26 14:37:37.905619 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Jul 26 14:37:37.907198 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 100/211] 10.222.0.93 () {56 vars in 1099 bytes} [Tue Jul 26 14:37:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:37:37.912959 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1feb05-e48d-410c-85cb-564182b37375 None None] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:37:38.057225 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:37:38.096383 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac91801-749c-46cb-893e-488c4e804187 None None] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:38.096635 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac91801-749c-46cb-893e-488c4e804187 None None] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:38.096905 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac91801-749c-46cb-893e-488c4e804187 None None] PATH_INFO: `/` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:38.098858 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 101/212] 10.222.0.93 () {54 vars in 926 bytes} [Tue Jul 26 14:37:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 14:37:38.105016 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43efdea1-394e-4db4-b70f-146129edcfa2 None None] REQUEST_METHOD: `POST` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:38.105976 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43efdea1-394e-4db4-b70f-146129edcfa2 None None] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:38.107033 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43efdea1-394e-4db4-b70f-146129edcfa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:38.127914 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1feb05-e48d-410c-85cb-564182b37375 None None] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:37:38.129061 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.auth.core [None req-43efdea1-394e-4db4-b70f-146129edcfa2 None None] MFA Rules not processed for user `e5ef88cc058f425b882bcb87a1e1e75c`. Rule list: `[]` (Enabled: `True`). {{(pid=87055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:37:38.130556 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.fernet_utils [None req-43efdea1-394e-4db4-b70f-146129edcfa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:37:38.189954 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29934d9d-7fb2-4794-bc0e-59356edf3815 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:37:38.190655 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29934d9d-7fb2-4794-bc0e-59356edf3815 None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:38.190944 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29934d9d-7fb2-4794-bc0e-59356edf3815 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:38.191219 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29934d9d-7fb2-4794-bc0e-59356edf3815 None admin] PATH_INFO: `/v3/roles` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:38.191956 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29934d9d-7fb2-4794-bc0e-59356edf3815 None admin] RBAC: Adding query filter params (name=member) {{(pid=87056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:37:38.192264 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29934d9d-7fb2-4794-bc0e-59356edf3815 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:37:38.193689 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29934d9d-7fb2-4794-bc0e-59356edf3815 None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:37:38.205909 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 112/213] 10.222.0.93 () {56 vars in 1101 bytes} [Tue Jul 26 14:37:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:37:38.213533 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29934d9d-7fb2-4794-bc0e-59356edf3815 None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:37:38.243699 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 102/214] 10.222.0.93 () {58 vars in 1023 bytes} [Tue Jul 26 14:37:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 14:37:38.287614 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43efdea1-394e-4db4-b70f-146129edcfa2 None None] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:37:38.332834 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29934d9d-7fb2-4794-bc0e-59356edf3815 None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:37:38.380931 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4321f8f-5ddd-42be-93af-91a136e7b937 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:37:38.382048 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4321f8f-5ddd-42be-93af-91a136e7b937 None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:38.382367 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4321f8f-5ddd-42be-93af-91a136e7b937 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:38.389363 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4321f8f-5ddd-42be-93af-91a136e7b937 None admin] PATH_INFO: `/v3/users/756f8f779082446faa20e302010bf17c` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:38.389363 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:37:38.403514 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4321f8f-5ddd-42be-93af-91a136e7b937 None admin] RBAC: Authorizing `identity:get_user(user_id=756f8f779082446faa20e302010bf17c)` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:37:38.407417 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4321f8f-5ddd-42be-93af-91a136e7b937 None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:37:38.411708 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 113/215] 10.222.0.93 () {56 vars in 1177 bytes} [Tue Jul 26 14:37:38 2022] GET /identity/v3/users/756f8f779082446faa20e302010bf17c => generated 297 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:37:38.418392 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4321f8f-5ddd-42be-93af-91a136e7b937 None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:37:38.426991 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:37:38.474493 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43efdea1-394e-4db4-b70f-146129edcfa2 None None] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:37:38.527319 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59df3812-f1d0-4d53-9d45-c17001205666 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:37:38.528342 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59df3812-f1d0-4d53-9d45-c17001205666 None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:38.528801 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59df3812-f1d0-4d53-9d45-c17001205666 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:38.529284 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59df3812-f1d0-4d53-9d45-c17001205666 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:38.531230 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59df3812-f1d0-4d53-9d45-c17001205666 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:37:38.534477 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59df3812-f1d0-4d53-9d45-c17001205666 None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:37:38.537132 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 103/216] 10.222.0.93 () {56 vars in 1108 bytes} [Tue Jul 26 14:37:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:37:38.546469 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59df3812-f1d0-4d53-9d45-c17001205666 None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:37:38.608745 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4321f8f-5ddd-42be-93af-91a136e7b937 None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:37:38.700092 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7401d84-9868-41b5-a0e1-5623fb05accc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:37:38.701634 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7401d84-9868-41b5-a0e1-5623fb05accc None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:38.703083 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7401d84-9868-41b5-a0e1-5623fb05accc None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:38.703731 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7401d84-9868-41b5-a0e1-5623fb05accc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:38.724581 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59df3812-f1d0-4d53-9d45-c17001205666 None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:37:38.782859 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4519e4-d869-4ecb-bb5e-3ed95ae72167 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:37:38.783900 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4519e4-d869-4ecb-bb5e-3ed95ae72167 None admin] REQUEST_METHOD: `POST` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:38.784372 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4519e4-d869-4ecb-bb5e-3ed95ae72167 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:38.784865 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4519e4-d869-4ecb-bb5e-3ed95ae72167 None admin] PATH_INFO: `/v3/users` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:38.786189 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4519e4-d869-4ecb-bb5e-3ed95ae72167 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:37:38.789076 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4519e4-d869-4ecb-bb5e-3ed95ae72167 None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:37:38.817593 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:37:38.835932 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:37:38.857371 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7401d84-9868-41b5-a0e1-5623fb05accc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:37:38.860515 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7401d84-9868-41b5-a0e1-5623fb05accc None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:37:38.976157 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 104/217] 10.222.0.93 () {60 vars in 1132 bytes} [Tue Jul 26 14:37:38 2022] POST /identity/v3/users => generated 297 bytes in 430 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 14:37:38.977571 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d964fb-0566-45b0-b05a-ceffc417c9a3 None None] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:38.977858 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d964fb-0566-45b0-b05a-ceffc417c9a3 None None] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:38.978377 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d964fb-0566-45b0-b05a-ceffc417c9a3 None None] PATH_INFO: `/` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:38.980202 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 105/218] 10.222.0.93 () {54 vars in 926 bytes} [Tue Jul 26 14:37:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:37:38.982086 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0c8610-5bd0-423c-80d5-67a9dbdcdf7d None None] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:38.982686 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0c8610-5bd0-423c-80d5-67a9dbdcdf7d None None] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:38.983151 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0c8610-5bd0-423c-80d5-67a9dbdcdf7d None None] PATH_INFO: `/` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:38.985144 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 106/219] 10.222.0.93 () {54 vars in 926 bytes} [Tue Jul 26 14:37:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:37:38.992125 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ead0e5-32a4-4305-a436-958bc6caef76 None None] REQUEST_METHOD: `POST` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:38.992125 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ead0e5-32a4-4305-a436-958bc6caef76 None None] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:38.992125 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ead0e5-32a4-4305-a436-958bc6caef76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:39.011985 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.auth.core [None req-63ead0e5-32a4-4305-a436-958bc6caef76 None None] MFA Rules not processed for user `e5ef88cc058f425b882bcb87a1e1e75c`. Rule list: `[]` (Enabled: `True`). {{(pid=87055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:37:39.013329 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.fernet_utils [None req-63ead0e5-32a4-4305-a436-958bc6caef76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:37:39.018358 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 114/220] 10.222.0.93 () {58 vars in 1282 bytes} [Tue Jul 26 14:37:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 596 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 26 14:37:39.018358 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb113845-f2b2-4e44-9419-79fb3619c415 None None] REQUEST_METHOD: `POST` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:39.018358 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb113845-f2b2-4e44-9419-79fb3619c415 None None] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:39.018358 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb113845-f2b2-4e44-9419-79fb3619c415 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:39.038500 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.auth.core [None req-fb113845-f2b2-4e44-9419-79fb3619c415 None None] MFA Rules not processed for user `e5ef88cc058f425b882bcb87a1e1e75c`. Rule list: `[]` (Enabled: `True`). {{(pid=87056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:37:39.049441 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.fernet_utils [None req-fb113845-f2b2-4e44-9419-79fb3619c415 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:37:39.099231 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 107/221] 10.222.0.93 () {58 vars in 1023 bytes} [Tue Jul 26 14:37:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 14:37:39.100071 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ead0e5-32a4-4305-a436-958bc6caef76 None None] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:37:39.129005 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 115/222] 10.222.0.93 () {58 vars in 1023 bytes} [Tue Jul 26 14:37:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 14:37:39.130271 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb113845-f2b2-4e44-9419-79fb3619c415 None None] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:37:39.164571 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:37:39.234490 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ead0e5-32a4-4305-a436-958bc6caef76 None None] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:37:39.278164 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:37:39.295988 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2482c4db-c34d-4814-8a13-ad3f367ab3cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:37:39.296258 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb113845-f2b2-4e44-9419-79fb3619c415 None None] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:37:39.297035 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2482c4db-c34d-4814-8a13-ad3f367ab3cb None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:39.297478 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2482c4db-c34d-4814-8a13-ad3f367ab3cb None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:39.297923 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2482c4db-c34d-4814-8a13-ad3f367ab3cb None admin] PATH_INFO: `/v3/projects/223cfb51fde24882a520cb183c0f36f8` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:39.300182 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2482c4db-c34d-4814-8a13-ad3f367ab3cb None admin] RBAC: Authorizing `identity:get_project(project_id=223cfb51fde24882a520cb183c0f36f8)` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:37:39.302173 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2482c4db-c34d-4814-8a13-ad3f367ab3cb None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:37:39.306297 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 108/223] 10.222.0.93 () {56 vars in 1186 bytes} [Tue Jul 26 14:37:39 2022] GET /identity/v3/projects/223cfb51fde24882a520cb183c0f36f8 => generated 302 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:37:39.307593 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2482c4db-c34d-4814-8a13-ad3f367ab3cb None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:37:39.372922 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6fbf1b-1932-487a-8035-3fcde00b2ba5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:37:39.374055 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6fbf1b-1932-487a-8035-3fcde00b2ba5 None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:39.374550 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6fbf1b-1932-487a-8035-3fcde00b2ba5 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:39.375006 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6fbf1b-1932-487a-8035-3fcde00b2ba5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:39.398008 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6fbf1b-1932-487a-8035-3fcde00b2ba5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 14:37:39.407911 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application [None req-3b6fbf1b-1932-487a-8035-3fcde00b2ba5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 14:37:39.407911 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:37:39.407911 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:37:39.407911 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:37:39.407911 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:37:39.407911 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:37:39.407911 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:37:39.407911 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:37:39.407911 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:37:39.407911 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:37:39.407911 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:37:39.407911 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:37:39.407911 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 14:37:39.407911 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 14:37:39.407911 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 14:37:39.407911 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 14:37:39.409539 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 14:37:39.409539 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 14:37:39.409539 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 14:37:39.409539 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 14:37:39.409539 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:37:39.409539 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:37:39.409539 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:37:39.409539 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:37:39.409539 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:37:39.409539 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:37:39.409539 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:37:39.409539 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application with Lock( Jul 26 14:37:39.409539 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:37:39.409539 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:37:39.409539 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:37:39.409539 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:37:39.411634 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:37:39.411634 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:37:39.411634 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:37:39.411634 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:37:39.411634 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 14:37:39.411634 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 14:37:39.411634 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 14:37:39.411634 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 14:37:39.411634 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 14:37:39.411634 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 14:37:39.411634 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 14:37:39.411634 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Jul 26 14:37:39.411634 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 116/224] 10.222.0.93 () {56 vars in 1096 bytes} [Tue Jul 26 14:37:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:37:39.412839 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6fbf1b-1932-487a-8035-3fcde00b2ba5 None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:37:39.536162 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2482c4db-c34d-4814-8a13-ad3f367ab3cb None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:37:39.569120 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:37:39.595977 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6fbf1b-1932-487a-8035-3fcde00b2ba5 None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:37:39.600992 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab7b459-56a1-45ef-9719-81093dba0ee9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:37:39.602209 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab7b459-56a1-45ef-9719-81093dba0ee9 None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:39.603500 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab7b459-56a1-45ef-9719-81093dba0ee9 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:39.603989 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab7b459-56a1-45ef-9719-81093dba0ee9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:39.625597 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab7b459-56a1-45ef-9719-81093dba0ee9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 14:37:39.637493 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application [None req-7ab7b459-56a1-45ef-9719-81093dba0ee9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 14:37:39.637493 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:37:39.637493 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:37:39.637493 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:37:39.637493 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:37:39.637493 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:37:39.637493 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:37:39.637493 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:37:39.637493 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:37:39.637493 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:37:39.637493 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:37:39.637493 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:37:39.637493 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 14:37:39.637493 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 14:37:39.637493 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 14:37:39.637493 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 14:37:39.639228 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 14:37:39.639228 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 14:37:39.639228 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 14:37:39.639228 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 14:37:39.639228 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:37:39.639228 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:37:39.639228 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:37:39.639228 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:37:39.639228 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:37:39.639228 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:37:39.639228 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:37:39.639228 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application with Lock( Jul 26 14:37:39.639228 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:37:39.639228 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:37:39.639228 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:37:39.639228 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:37:39.641631 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:37:39.641631 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:37:39.641631 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:37:39.641631 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:37:39.641631 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 14:37:39.641631 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 14:37:39.641631 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 14:37:39.641631 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 14:37:39.641631 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 14:37:39.641631 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 14:37:39.641631 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 14:37:39.641631 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Jul 26 14:37:39.641631 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 109/225] 10.222.0.93 () {56 vars in 1114 bytes} [Tue Jul 26 14:37:39 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 333 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:37:39.641631 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab7b459-56a1-45ef-9719-81093dba0ee9 None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:37:39.666142 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08caca7b-0bfb-4929-9d21-fcdb078e4927 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:37:39.667757 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08caca7b-0bfb-4929-9d21-fcdb078e4927 None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:39.668628 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08caca7b-0bfb-4929-9d21-fcdb078e4927 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:39.669187 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08caca7b-0bfb-4929-9d21-fcdb078e4927 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:39.670904 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08caca7b-0bfb-4929-9d21-fcdb078e4927 None admin] RBAC: Adding query filter params (role.id=8b8a4a451dc84c17bba824b2ff9cc4fe, scope.project.id=223cfb51fde24882a520cb183c0f36f8, user.id=756f8f779082446faa20e302010bf17c) {{(pid=87056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:37:39.671574 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08caca7b-0bfb-4929-9d21-fcdb078e4927 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:37:39.674736 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08caca7b-0bfb-4929-9d21-fcdb078e4927 None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:37:39.685729 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 117/226] 10.222.0.93 () {56 vars in 1374 bytes} [Tue Jul 26 14:37:39 2022] GET /identity/v3/role_assignments?user.id=756f8f779082446faa20e302010bf17c&scope.project.id=223cfb51fde24882a520cb183c0f36f8&role.id=8b8a4a451dc84c17bba824b2ff9cc4fe => generated 259 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:37:39.697975 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08caca7b-0bfb-4929-9d21-fcdb078e4927 None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:37:39.810362 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:37:39.952787 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab7b459-56a1-45ef-9719-81093dba0ee9 None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:37:40.021268 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7864985a-ee36-4cd4-9d42-d95221bfe7fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:37:40.021911 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7864985a-ee36-4cd4-9d42-d95221bfe7fe None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:40.022193 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7864985a-ee36-4cd4-9d42-d95221bfe7fe None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:40.022511 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7864985a-ee36-4cd4-9d42-d95221bfe7fe None admin] PATH_INFO: `/v3/roles` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:40.023378 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7864985a-ee36-4cd4-9d42-d95221bfe7fe None admin] RBAC: Adding query filter params (name=admin) {{(pid=87055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:37:40.023835 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7864985a-ee36-4cd4-9d42-d95221bfe7fe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:37:40.027094 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7864985a-ee36-4cd4-9d42-d95221bfe7fe None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:37:40.035508 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08caca7b-0bfb-4929-9d21-fcdb078e4927 None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:37:40.064170 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 110/227] 10.222.0.93 () {56 vars in 1099 bytes} [Tue Jul 26 14:37:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 423 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:37:40.073171 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7864985a-ee36-4cd4-9d42-d95221bfe7fe None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:37:40.173001 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b32721e-43d3-4e74-99c2-b1061098707d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:37:40.174137 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b32721e-43d3-4e74-99c2-b1061098707d None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:40.174644 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b32721e-43d3-4e74-99c2-b1061098707d None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:40.175135 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b32721e-43d3-4e74-99c2-b1061098707d None admin] PATH_INFO: `/v3/roles` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:40.176437 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b32721e-43d3-4e74-99c2-b1061098707d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:37:40.176984 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b32721e-43d3-4e74-99c2-b1061098707d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:37:40.179569 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b32721e-43d3-4e74-99c2-b1061098707d None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:37:40.223348 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 118/228] 10.222.0.93 () {56 vars in 1111 bytes} [Tue Jul 26 14:37:39 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 537 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:37:40.239484 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b32721e-43d3-4e74-99c2-b1061098707d None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:37:40.275951 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:37:40.422717 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7864985a-ee36-4cd4-9d42-d95221bfe7fe None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:37:40.442459 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:37:40.507466 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea8eb4d-0047-4285-883c-49542ea095b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:37:40.509008 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea8eb4d-0047-4285-883c-49542ea095b7 None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:40.509828 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea8eb4d-0047-4285-883c-49542ea095b7 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:40.510652 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea8eb4d-0047-4285-883c-49542ea095b7 None admin] PATH_INFO: `/v3/users/1561cf57fa494e5ab6566a7df55ad58e` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:40.513205 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea8eb4d-0047-4285-883c-49542ea095b7 None admin] RBAC: Authorizing `identity:get_user(user_id=1561cf57fa494e5ab6566a7df55ad58e)` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:37:40.518790 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea8eb4d-0047-4285-883c-49542ea095b7 None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:37:40.530896 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 111/229] 10.222.0.93 () {56 vars in 1177 bytes} [Tue Jul 26 14:37:40 2022] GET /identity/v3/users/1561cf57fa494e5ab6566a7df55ad58e => generated 283 bytes in 460 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:37:40.537062 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea8eb4d-0047-4285-883c-49542ea095b7 None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:37:40.564998 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b32721e-43d3-4e74-99c2-b1061098707d None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:37:40.643779 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8520933-ad00-4866-9dc4-2578ee5f3500 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:37:40.645350 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8520933-ad00-4866-9dc4-2578ee5f3500 None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:40.646137 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8520933-ad00-4866-9dc4-2578ee5f3500 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:40.646931 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8520933-ad00-4866-9dc4-2578ee5f3500 None admin] PATH_INFO: `/v3/users/1561cf57fa494e5ab6566a7df55ad58e` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:40.650535 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8520933-ad00-4866-9dc4-2578ee5f3500 None admin] RBAC: Authorizing `identity:get_user(user_id=1561cf57fa494e5ab6566a7df55ad58e)` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:37:40.653203 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8520933-ad00-4866-9dc4-2578ee5f3500 None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:37:40.657171 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 119/230] 10.222.0.93 () {56 vars in 1177 bytes} [Tue Jul 26 14:37:40 2022] GET /identity/v3/users/1561cf57fa494e5ab6566a7df55ad58e => generated 283 bytes in 418 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:37:40.667921 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8520933-ad00-4866-9dc4-2578ee5f3500 None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:37:40.859717 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea8eb4d-0047-4285-883c-49542ea095b7 None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:37:40.864497 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:37:40.908847 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8520933-ad00-4866-9dc4-2578ee5f3500 None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:37:40.967060 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f5b188-448e-4358-8eb5-07da65991f02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:37:40.968104 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f5b188-448e-4358-8eb5-07da65991f02 None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:40.968588 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f5b188-448e-4358-8eb5-07da65991f02 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:40.969058 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f5b188-448e-4358-8eb5-07da65991f02 None admin] PATH_INFO: `/v3/projects/223cfb51fde24882a520cb183c0f36f8` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:40.971030 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f5b188-448e-4358-8eb5-07da65991f02 None admin] RBAC: Authorizing `identity:get_project(project_id=223cfb51fde24882a520cb183c0f36f8)` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:37:40.972886 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f5b188-448e-4358-8eb5-07da65991f02 None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:37:40.975332 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 112/231] 10.222.0.93 () {56 vars in 1186 bytes} [Tue Jul 26 14:37:40 2022] GET /identity/v3/projects/223cfb51fde24882a520cb183c0f36f8 => generated 302 bytes in 439 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:37:40.982226 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f5b188-448e-4358-8eb5-07da65991f02 None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:37:41.007844 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1678e7-2bea-49f0-82ae-d6fd3b8e019e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:37:41.009510 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1678e7-2bea-49f0-82ae-d6fd3b8e019e None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:41.010428 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1678e7-2bea-49f0-82ae-d6fd3b8e019e None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:41.010540 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1678e7-2bea-49f0-82ae-d6fd3b8e019e None admin] PATH_INFO: `/v3/projects/223cfb51fde24882a520cb183c0f36f8` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:41.012630 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1678e7-2bea-49f0-82ae-d6fd3b8e019e None admin] RBAC: Authorizing `identity:get_project(project_id=223cfb51fde24882a520cb183c0f36f8)` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:37:41.015365 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1678e7-2bea-49f0-82ae-d6fd3b8e019e None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:37:41.027055 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 120/232] 10.222.0.93 () {56 vars in 1186 bytes} [Tue Jul 26 14:37:40 2022] GET /identity/v3/projects/223cfb51fde24882a520cb183c0f36f8 => generated 302 bytes in 360 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:37:41.036659 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1678e7-2bea-49f0-82ae-d6fd3b8e019e None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:37:41.049508 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:37:41.103022 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f5b188-448e-4358-8eb5-07da65991f02 None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:37:41.142205 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f57f549-ea28-4276-b90d-e1067904da07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:37:41.143270 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f57f549-ea28-4276-b90d-e1067904da07 None admin] REQUEST_METHOD: `PUT` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:41.143800 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f57f549-ea28-4276-b90d-e1067904da07 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:41.144349 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f57f549-ea28-4276-b90d-e1067904da07 None admin] PATH_INFO: `/v3/projects/223cfb51fde24882a520cb183c0f36f8/users/1561cf57fa494e5ab6566a7df55ad58e/roles/94e105ff8ee4486abd501415cc05ba38` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:41.146763 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f57f549-ea28-4276-b90d-e1067904da07 None admin] RBAC: Authorizing `identity:create_grant(project_id=223cfb51fde24882a520cb183c0f36f8, user_id=1561cf57fa494e5ab6566a7df55ad58e, role_id=94e105ff8ee4486abd501415cc05ba38)` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:37:41.148528 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f57f549-ea28-4276-b90d-e1067904da07 None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:37:41.271835 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1678e7-2bea-49f0-82ae-d6fd3b8e019e None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:37:41.305268 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 113/233] 10.222.0.93 () {58 vars in 1439 bytes} [Tue Jul 26 14:37:40 2022] PUT /identity/v3/projects/223cfb51fde24882a520cb183c0f36f8/users/1561cf57fa494e5ab6566a7df55ad58e/roles/94e105ff8ee4486abd501415cc05ba38 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 14:37:41.344995 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b3a7d2-5830-47c9-b11f-76c6d5a5a835 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:37:41.346194 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b3a7d2-5830-47c9-b11f-76c6d5a5a835 None admin] REQUEST_METHOD: `PUT` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:41.346716 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b3a7d2-5830-47c9-b11f-76c6d5a5a835 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:41.347204 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b3a7d2-5830-47c9-b11f-76c6d5a5a835 None admin] PATH_INFO: `/v3/projects/223cfb51fde24882a520cb183c0f36f8/users/1561cf57fa494e5ab6566a7df55ad58e/roles/ef1a806f8d774452a6536b57a4670ceb` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:41.357493 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b3a7d2-5830-47c9-b11f-76c6d5a5a835 None admin] RBAC: Authorizing `identity:create_grant(project_id=223cfb51fde24882a520cb183c0f36f8, user_id=1561cf57fa494e5ab6566a7df55ad58e, role_id=ef1a806f8d774452a6536b57a4670ceb)` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:37:41.359909 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b3a7d2-5830-47c9-b11f-76c6d5a5a835 None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:37:41.477792 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 121/234] 10.222.0.93 () {58 vars in 1439 bytes} [Tue Jul 26 14:37:41 2022] PUT /identity/v3/projects/223cfb51fde24882a520cb183c0f36f8/users/1561cf57fa494e5ab6566a7df55ad58e/roles/ef1a806f8d774452a6536b57a4670ceb => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 14:37:41.865940 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59544723-c946-47ff-ac63-f89197d4b342 None None] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:41.867039 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59544723-c946-47ff-ac63-f89197d4b342 None None] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:41.867528 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59544723-c946-47ff-ac63-f89197d4b342 None None] PATH_INFO: `/` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:41.869338 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 114/235] 10.222.0.93 () {54 vars in 926 bytes} [Tue Jul 26 14:37:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 14:37:41.875325 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c4ad19-9389-4d79-8373-0dcc3f726540 None None] REQUEST_METHOD: `POST` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:41.876262 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c4ad19-9389-4d79-8373-0dcc3f726540 None None] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:41.876952 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c4ad19-9389-4d79-8373-0dcc3f726540 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:41.885775 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:37:41.900533 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.auth.core [None req-d2c4ad19-9389-4d79-8373-0dcc3f726540 None None] MFA Rules not processed for user `e5ef88cc058f425b882bcb87a1e1e75c`. Rule list: `[]` (Enabled: `True`). {{(pid=87056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:37:41.903242 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.fernet_utils [None req-d2c4ad19-9389-4d79-8373-0dcc3f726540 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:37:41.935286 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c51693-5320-4d5f-aa83-a91d5bef5d41 None None] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:41.935573 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c51693-5320-4d5f-aa83-a91d5bef5d41 None None] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:41.937531 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c51693-5320-4d5f-aa83-a91d5bef5d41 None None] PATH_INFO: `/` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:41.937683 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 115/236] 10.222.0.93 () {54 vars in 926 bytes} [Tue Jul 26 14:37:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:37:41.953600 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21098e9-d580-4605-b775-8cffd5405bf4 None None] REQUEST_METHOD: `POST` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:41.953890 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21098e9-d580-4605-b775-8cffd5405bf4 None None] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:41.954167 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21098e9-d580-4605-b775-8cffd5405bf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:41.994611 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.auth.core [None req-d21098e9-d580-4605-b775-8cffd5405bf4 None None] MFA Rules not processed for user `e5ef88cc058f425b882bcb87a1e1e75c`. Rule list: `[]` (Enabled: `True`). {{(pid=87055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:37:41.996597 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.fernet_utils [None req-d21098e9-d580-4605-b775-8cffd5405bf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:37:42.029582 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 122/237] 10.222.0.93 () {58 vars in 1023 bytes} [Tue Jul 26 14:37:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 14:37:42.074208 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c4ad19-9389-4d79-8373-0dcc3f726540 None None] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:37:42.128267 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 116/238] 10.222.0.93 () {58 vars in 1023 bytes} [Tue Jul 26 14:37:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 14:37:42.165884 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21098e9-d580-4605-b775-8cffd5405bf4 None None] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:37:42.270416 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:37:42.271987 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c4ad19-9389-4d79-8373-0dcc3f726540 None None] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:37:42.341876 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f188772-d5c7-413e-9078-56d688487dc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:37:42.343029 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f188772-d5c7-413e-9078-56d688487dc2 None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:42.343484 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f188772-d5c7-413e-9078-56d688487dc2 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:42.343956 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f188772-d5c7-413e-9078-56d688487dc2 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:42.347490 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:37:42.373987 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f188772-d5c7-413e-9078-56d688487dc2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 14:37:42.377939 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21098e9-d580-4605-b775-8cffd5405bf4 None None] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:37:42.379606 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application [None req-4f188772-d5c7-413e-9078-56d688487dc2 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 26 14:37:42.379606 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:37:42.379606 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:37:42.379606 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:37:42.379606 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:37:42.379606 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:37:42.379606 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:37:42.379606 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:37:42.379606 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:37:42.379606 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:37:42.379606 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:37:42.379606 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:37:42.379606 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 14:37:42.379606 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 14:37:42.379606 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 14:37:42.379606 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 14:37:42.380453 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 14:37:42.380453 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 14:37:42.380453 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 14:37:42.380453 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 14:37:42.380453 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:37:42.380453 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:37:42.380453 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:37:42.380453 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:37:42.380453 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:37:42.380453 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:37:42.380453 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:37:42.380453 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application with Lock( Jul 26 14:37:42.380453 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:37:42.380453 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:37:42.380453 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:37:42.380453 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:37:42.381778 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:37:42.381778 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:37:42.381778 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:37:42.381778 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:37:42.381778 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 14:37:42.381778 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 14:37:42.381778 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 14:37:42.381778 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 14:37:42.381778 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 14:37:42.381778 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 14:37:42.381778 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 26 14:37:42.381778 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Jul 26 14:37:42.381778 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 123/239] 10.222.0.93 () {56 vars in 1099 bytes} [Tue Jul 26 14:37:42 2022] GET /identity/v3/roles/reader => generated 84 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 14:37:42.388643 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c703d298-6a30-4fd7-973b-0028120cd37c None None] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:42.389349 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c703d298-6a30-4fd7-973b-0028120cd37c None None] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:42.389978 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c703d298-6a30-4fd7-973b-0028120cd37c None None] PATH_INFO: `/` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:42.394033 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 124/240] 10.222.0.93 () {54 vars in 926 bytes} [Tue Jul 26 14:37:42 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:37:42.395618 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c703d298-6a30-4fd7-973b-0028120cd37c None None] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:37:42.435471 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11be46d-6138-4833-a3ac-07059bdbd8a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:37:42.436153 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11be46d-6138-4833-a3ac-07059bdbd8a5 None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:42.436437 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11be46d-6138-4833-a3ac-07059bdbd8a5 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:42.436717 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11be46d-6138-4833-a3ac-07059bdbd8a5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:42.437962 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11be46d-6138-4833-a3ac-07059bdbd8a5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:37:42.440272 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11be46d-6138-4833-a3ac-07059bdbd8a5 None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:37:42.442843 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 117/241] 10.222.0.93 () {56 vars in 1108 bytes} [Tue Jul 26 14:37:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:37:42.444227 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c1584a-9ce7-418f-b67e-1bd6fed69954 None None] REQUEST_METHOD: `POST` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:42.444484 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c1584a-9ce7-418f-b67e-1bd6fed69954 None None] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:42.444767 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c1584a-9ce7-418f-b67e-1bd6fed69954 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:42.470792 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.auth.core [None req-c5c1584a-9ce7-418f-b67e-1bd6fed69954 None None] MFA Rules not processed for user `e5ef88cc058f425b882bcb87a1e1e75c`. Rule list: `[]` (Enabled: `True`). {{(pid=87055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:37:42.472100 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.fernet_utils [None req-c5c1584a-9ce7-418f-b67e-1bd6fed69954 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:37:42.556162 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 118/242] 10.222.0.93 () {58 vars in 1023 bytes} [Tue Jul 26 14:37:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 14:37:42.557930 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c1584a-9ce7-418f-b67e-1bd6fed69954 None None] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:37:42.607765 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:37:42.612274 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c703d298-6a30-4fd7-973b-0028120cd37c None None] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:37:42.678602 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891f1265-b65d-4eb8-8977-cecdc28a1003 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:37:42.679498 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891f1265-b65d-4eb8-8977-cecdc28a1003 None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:42.679744 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c1584a-9ce7-418f-b67e-1bd6fed69954 None None] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:37:42.679969 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891f1265-b65d-4eb8-8977-cecdc28a1003 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:42.680913 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891f1265-b65d-4eb8-8977-cecdc28a1003 None admin] PATH_INFO: `/v3/roles` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:42.682158 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891f1265-b65d-4eb8-8977-cecdc28a1003 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:37:42.682753 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891f1265-b65d-4eb8-8977-cecdc28a1003 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:37:42.685235 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891f1265-b65d-4eb8-8977-cecdc28a1003 None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:37:42.705391 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 125/243] 10.222.0.93 () {56 vars in 1101 bytes} [Tue Jul 26 14:37:42 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:37:42.710025 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891f1265-b65d-4eb8-8977-cecdc28a1003 None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:37:42.732414 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b8758b-72c8-4a66-bc79-5b9eebc7e85e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:37:42.733309 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b8758b-72c8-4a66-bc79-5b9eebc7e85e None admin] REQUEST_METHOD: `POST` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:42.733782 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b8758b-72c8-4a66-bc79-5b9eebc7e85e None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:42.734212 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b8758b-72c8-4a66-bc79-5b9eebc7e85e None admin] PATH_INFO: `/v3/users` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:42.735134 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b8758b-72c8-4a66-bc79-5b9eebc7e85e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:37:42.736807 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b8758b-72c8-4a66-bc79-5b9eebc7e85e None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:37:42.816490 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:37:42.897129 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891f1265-b65d-4eb8-8977-cecdc28a1003 None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:37:42.908231 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 119/244] 10.222.0.93 () {60 vars in 1132 bytes} [Tue Jul 26 14:37:42 2022] POST /identity/v3/users => generated 293 bytes in 352 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 14:37:42.909934 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b8758b-72c8-4a66-bc79-5b9eebc7e85e None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:37:43.002466 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d3584a-8994-411f-8054-dec6cf61b64d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:37:43.003423 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d3584a-8994-411f-8054-dec6cf61b64d None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:43.003865 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d3584a-8994-411f-8054-dec6cf61b64d None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:43.004294 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d3584a-8994-411f-8054-dec6cf61b64d None admin] PATH_INFO: `/v3/roles/member` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:43.030283 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d3584a-8994-411f-8054-dec6cf61b64d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 14:37:43.036936 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application [None req-59d3584a-8994-411f-8054-dec6cf61b64d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 26 14:37:43.036936 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:37:43.036936 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:37:43.036936 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:37:43.036936 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:37:43.036936 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:37:43.036936 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:37:43.036936 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:37:43.036936 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:37:43.036936 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:37:43.036936 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:37:43.036936 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:37:43.036936 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 14:37:43.036936 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 14:37:43.036936 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 14:37:43.036936 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 14:37:43.037913 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 14:37:43.037913 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 14:37:43.037913 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 14:37:43.037913 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 14:37:43.037913 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:37:43.037913 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:37:43.037913 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:37:43.037913 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:37:43.037913 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:37:43.037913 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:37:43.037913 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:37:43.037913 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application with Lock( Jul 26 14:37:43.037913 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:37:43.037913 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:37:43.037913 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:37:43.037913 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:37:43.038735 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:37:43.038735 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:37:43.038735 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:37:43.038735 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:37:43.038735 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 14:37:43.038735 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 14:37:43.038735 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 14:37:43.038735 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 14:37:43.038735 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 14:37:43.038735 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 14:37:43.038735 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 26 14:37:43.038735 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Jul 26 14:37:43.042492 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 126/245] 10.222.0.93 () {56 vars in 1099 bytes} [Tue Jul 26 14:37:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 336 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:37:43.052103 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d3584a-8994-411f-8054-dec6cf61b64d None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:37:43.190977 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:37:43.205464 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b8758b-72c8-4a66-bc79-5b9eebc7e85e None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:37:43.241031 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d3584a-8994-411f-8054-dec6cf61b64d None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:37:43.265811 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a41df9b-5e85-47a7-aa78-b4f4428779ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:37:43.266659 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a41df9b-5e85-47a7-aa78-b4f4428779ba None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:43.267118 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a41df9b-5e85-47a7-aa78-b4f4428779ba None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:43.267514 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a41df9b-5e85-47a7-aa78-b4f4428779ba None admin] PATH_INFO: `/v3/users/885a2a4652614d04a7c831bab4159c0e` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:43.276046 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:37:43.309360 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a41df9b-5e85-47a7-aa78-b4f4428779ba None admin] RBAC: Authorizing `identity:get_user(user_id=885a2a4652614d04a7c831bab4159c0e)` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:37:43.312936 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a41df9b-5e85-47a7-aa78-b4f4428779ba None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:37:43.313133 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede0e050-defd-440e-a6c8-bad6edca48ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:37:43.313930 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede0e050-defd-440e-a6c8-bad6edca48ad None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:43.314524 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede0e050-defd-440e-a6c8-bad6edca48ad None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:43.314990 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede0e050-defd-440e-a6c8-bad6edca48ad None admin] PATH_INFO: `/v3/roles` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:43.316216 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede0e050-defd-440e-a6c8-bad6edca48ad None admin] RBAC: Adding query filter params (name=member) {{(pid=87056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:37:43.316869 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede0e050-defd-440e-a6c8-bad6edca48ad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:37:43.318011 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 120/246] 10.222.0.93 () {56 vars in 1177 bytes} [Tue Jul 26 14:37:42 2022] GET /identity/v3/users/885a2a4652614d04a7c831bab4159c0e => generated 297 bytes in 408 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:37:43.319089 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede0e050-defd-440e-a6c8-bad6edca48ad None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:37:43.325558 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a41df9b-5e85-47a7-aa78-b4f4428779ba None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:37:43.340490 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 127/247] 10.222.0.93 () {56 vars in 1101 bytes} [Tue Jul 26 14:37:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:37:43.346873 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede0e050-defd-440e-a6c8-bad6edca48ad None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:37:43.529515 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a41df9b-5e85-47a7-aa78-b4f4428779ba None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:37:43.564828 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede0e050-defd-440e-a6c8-bad6edca48ad None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:37:43.577706 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0fdd5e-5f5e-4d42-8cfb-289602ff6755 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:37:43.578487 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0fdd5e-5f5e-4d42-8cfb-289602ff6755 None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:43.578761 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0fdd5e-5f5e-4d42-8cfb-289602ff6755 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:43.579051 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0fdd5e-5f5e-4d42-8cfb-289602ff6755 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:43.608176 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35bd51e-5831-4e9f-b414-c10872909930 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:37:43.608852 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35bd51e-5831-4e9f-b414-c10872909930 None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:43.609138 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35bd51e-5831-4e9f-b414-c10872909930 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:43.609419 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35bd51e-5831-4e9f-b414-c10872909930 None admin] PATH_INFO: `/v3/users/756f8f779082446faa20e302010bf17c` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:43.610717 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35bd51e-5831-4e9f-b414-c10872909930 None admin] RBAC: Authorizing `identity:get_user(user_id=756f8f779082446faa20e302010bf17c)` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:37:43.611444 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:37:43.613047 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35bd51e-5831-4e9f-b414-c10872909930 None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:37:43.615129 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 128/248] 10.222.0.93 () {56 vars in 1177 bytes} [Tue Jul 26 14:37:43 2022] GET /identity/v3/users/756f8f779082446faa20e302010bf17c => generated 297 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:37:43.623152 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35bd51e-5831-4e9f-b414-c10872909930 None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:37:43.693375 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0fdd5e-5f5e-4d42-8cfb-289602ff6755 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:37:43.695927 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0fdd5e-5f5e-4d42-8cfb-289602ff6755 None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:37:43.712990 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:37:43.811267 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35bd51e-5831-4e9f-b414-c10872909930 None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:37:43.841617 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 121/249] 10.222.0.93 () {58 vars in 1282 bytes} [Tue Jul 26 14:37:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 517 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 26 14:37:43.847048 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0fdd5e-5f5e-4d42-8cfb-289602ff6755 None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:37:43.869561 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57fadff-4c96-4206-b710-a92a7978b2e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:37:43.870234 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57fadff-4c96-4206-b710-a92a7978b2e2 None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:43.870572 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57fadff-4c96-4206-b710-a92a7978b2e2 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:43.870849 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57fadff-4c96-4206-b710-a92a7978b2e2 None admin] PATH_INFO: `/v3/projects/223cfb51fde24882a520cb183c0f36f8` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:43.875169 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57fadff-4c96-4206-b710-a92a7978b2e2 None admin] RBAC: Authorizing `identity:get_project(project_id=223cfb51fde24882a520cb183c0f36f8)` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:37:43.876814 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57fadff-4c96-4206-b710-a92a7978b2e2 None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:37:43.878678 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 129/250] 10.222.0.93 () {56 vars in 1186 bytes} [Tue Jul 26 14:37:43 2022] GET /identity/v3/projects/223cfb51fde24882a520cb183c0f36f8 => generated 302 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:37:43.886144 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57fadff-4c96-4206-b710-a92a7978b2e2 None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:37:43.916749 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:37:43.973617 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0fdd5e-5f5e-4d42-8cfb-289602ff6755 None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:37:44.020563 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a1e1ac-6d9d-442f-bffe-a754805f5c86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:37:44.021342 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a1e1ac-6d9d-442f-bffe-a754805f5c86 None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:44.021702 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a1e1ac-6d9d-442f-bffe-a754805f5c86 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:44.022056 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a1e1ac-6d9d-442f-bffe-a754805f5c86 None admin] PATH_INFO: `/v3/projects/223cfb51fde24882a520cb183c0f36f8` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:44.023712 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a1e1ac-6d9d-442f-bffe-a754805f5c86 None admin] RBAC: Authorizing `identity:get_project(project_id=223cfb51fde24882a520cb183c0f36f8)` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:37:44.025344 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a1e1ac-6d9d-442f-bffe-a754805f5c86 None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:37:44.027665 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 122/251] 10.222.0.93 () {56 vars in 1186 bytes} [Tue Jul 26 14:37:43 2022] GET /identity/v3/projects/223cfb51fde24882a520cb183c0f36f8 => generated 302 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:37:44.034964 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a1e1ac-6d9d-442f-bffe-a754805f5c86 None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:37:44.120340 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57fadff-4c96-4206-b710-a92a7978b2e2 None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:37:44.138258 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:37:44.161186 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8682d0-1ff0-4ffd-ba54-55a15c9dc5a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:37:44.161880 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8682d0-1ff0-4ffd-ba54-55a15c9dc5a9 None admin] REQUEST_METHOD: `PUT` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:44.162159 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8682d0-1ff0-4ffd-ba54-55a15c9dc5a9 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:44.162483 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8682d0-1ff0-4ffd-ba54-55a15c9dc5a9 None admin] PATH_INFO: `/v3/projects/223cfb51fde24882a520cb183c0f36f8/users/756f8f779082446faa20e302010bf17c/roles/8b8a4a451dc84c17bba824b2ff9cc4fe` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:44.165849 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8682d0-1ff0-4ffd-ba54-55a15c9dc5a9 None admin] RBAC: Authorizing `identity:create_grant(project_id=223cfb51fde24882a520cb183c0f36f8, user_id=756f8f779082446faa20e302010bf17c, role_id=8b8a4a451dc84c17bba824b2ff9cc4fe)` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:37:44.167439 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8682d0-1ff0-4ffd-ba54-55a15c9dc5a9 None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:37:44.224683 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a1e1ac-6d9d-442f-bffe-a754805f5c86 None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:37:44.261245 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:37:44.273207 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e36ac0-2d61-40fb-84f7-027dda3dfd87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:37:44.273844 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e36ac0-2d61-40fb-84f7-027dda3dfd87 None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:44.274859 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e36ac0-2d61-40fb-84f7-027dda3dfd87 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:44.275226 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e36ac0-2d61-40fb-84f7-027dda3dfd87 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:44.276047 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e36ac0-2d61-40fb-84f7-027dda3dfd87 None admin] RBAC: Adding query filter params (role.id=8b206d8d963645f6bd492384b6c5d39f, scope.project.id=223cfb51fde24882a520cb183c0f36f8, user.id=885a2a4652614d04a7c831bab4159c0e) {{(pid=87055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:37:44.276365 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e36ac0-2d61-40fb-84f7-027dda3dfd87 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:37:44.277926 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e36ac0-2d61-40fb-84f7-027dda3dfd87 None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:37:44.284664 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 123/252] 10.222.0.93 () {56 vars in 1374 bytes} [Tue Jul 26 14:37:44 2022] GET /identity/v3/role_assignments?user.id=885a2a4652614d04a7c831bab4159c0e&scope.project.id=223cfb51fde24882a520cb183c0f36f8&role.id=8b206d8d963645f6bd492384b6c5d39f => generated 259 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:37:44.298532 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 130/253] 10.222.0.93 () {58 vars in 1439 bytes} [Tue Jul 26 14:37:43 2022] PUT /identity/v3/projects/223cfb51fde24882a520cb183c0f36f8/users/756f8f779082446faa20e302010bf17c/roles/8b8a4a451dc84c17bba824b2ff9cc4fe => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 14:37:44.480743 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d3c984-d8d3-4b09-ba30-d436f8e96712 None None] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:44.481172 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d3c984-d8d3-4b09-ba30-d436f8e96712 None None] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:44.481569 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d3c984-d8d3-4b09-ba30-d436f8e96712 None None] PATH_INFO: `/` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:44.483704 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 124/254] 10.222.0.93 () {54 vars in 926 bytes} [Tue Jul 26 14:37:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:37:44.490027 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcc50bd-46e1-49af-843a-b2ff77d284a0 None None] REQUEST_METHOD: `POST` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:44.490570 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcc50bd-46e1-49af-843a-b2ff77d284a0 None None] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:44.490966 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcc50bd-46e1-49af-843a-b2ff77d284a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:44.514171 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.auth.core [None req-fbcc50bd-46e1-49af-843a-b2ff77d284a0 None None] MFA Rules not processed for user `e5ef88cc058f425b882bcb87a1e1e75c`. Rule list: `[]` (Enabled: `True`). {{(pid=87056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:37:44.515622 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.fernet_utils [None req-fbcc50bd-46e1-49af-843a-b2ff77d284a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:37:44.648565 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 131/255] 10.222.0.93 () {58 vars in 1023 bytes} [Tue Jul 26 14:37:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 14:37:44.690825 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d3c984-d8d3-4b09-ba30-d436f8e96712 None None] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:37:44.737220 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6790899a-4249-4a10-8839-2b9c7abfe46e None None] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:44.737594 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6790899a-4249-4a10-8839-2b9c7abfe46e None None] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:44.738046 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6790899a-4249-4a10-8839-2b9c7abfe46e None None] PATH_INFO: `/` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:44.740709 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 132/256] 10.222.0.93 () {54 vars in 926 bytes} [Tue Jul 26 14:37:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:37:44.752707 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7a3ceb-5546-4df6-9563-54606eca1fff None None] REQUEST_METHOD: `POST` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:44.753137 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7a3ceb-5546-4df6-9563-54606eca1fff None None] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:44.753563 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7a3ceb-5546-4df6-9563-54606eca1fff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:44.816022 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.auth.core [None req-0f7a3ceb-5546-4df6-9563-54606eca1fff None None] MFA Rules not processed for user `e5ef88cc058f425b882bcb87a1e1e75c`. Rule list: `[]` (Enabled: `True`). {{(pid=87056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:37:44.817256 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.fernet_utils [None req-0f7a3ceb-5546-4df6-9563-54606eca1fff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:37:44.880076 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d3c984-d8d3-4b09-ba30-d436f8e96712 None None] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:37:44.951706 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86a13d4-15e8-45f8-8ed0-049f5ce7b7ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:37:44.952485 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86a13d4-15e8-45f8-8ed0-049f5ce7b7ed None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:44.952672 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86a13d4-15e8-45f8-8ed0-049f5ce7b7ed None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:44.952960 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86a13d4-15e8-45f8-8ed0-049f5ce7b7ed None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:44.990437 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86a13d4-15e8-45f8-8ed0-049f5ce7b7ed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 14:37:45.009110 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application [None req-d86a13d4-15e8-45f8-8ed0-049f5ce7b7ed None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 14:37:45.009110 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:37:45.009110 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:37:45.009110 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:37:45.009110 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:37:45.009110 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:37:45.009110 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:37:45.009110 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:37:45.009110 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:37:45.009110 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:37:45.009110 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:37:45.009110 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:37:45.009110 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 14:37:45.009110 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 14:37:45.009110 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 14:37:45.009110 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 14:37:45.010075 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 14:37:45.010075 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 14:37:45.010075 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 14:37:45.010075 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 14:37:45.010075 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:37:45.010075 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:37:45.010075 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:37:45.010075 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:37:45.010075 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:37:45.010075 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:37:45.010075 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:37:45.010075 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application with Lock( Jul 26 14:37:45.010075 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:37:45.010075 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:37:45.010075 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:37:45.010075 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:37:45.010896 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:37:45.010896 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:37:45.010896 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:37:45.010896 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:37:45.010896 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 14:37:45.010896 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 14:37:45.010896 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 14:37:45.010896 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 14:37:45.010896 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 14:37:45.010896 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 14:37:45.010896 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 14:37:45.010896 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Jul 26 14:37:45.014071 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 125/257] 10.222.0.93 () {56 vars in 1114 bytes} [Tue Jul 26 14:37:44 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 324 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:37:45.020799 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86a13d4-15e8-45f8-8ed0-049f5ce7b7ed None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:37:45.024006 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 133/258] 10.222.0.93 () {58 vars in 1023 bytes} [Tue Jul 26 14:37:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 14:37:45.064821 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7a3ceb-5546-4df6-9563-54606eca1fff None None] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:37:45.113523 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:37:45.161343 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:37:45.235007 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86a13d4-15e8-45f8-8ed0-049f5ce7b7ed None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:37:45.307327 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d566edf-04da-4ef3-9beb-f7ac77766a06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:37:45.307909 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d566edf-04da-4ef3-9beb-f7ac77766a06 None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:45.308197 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d566edf-04da-4ef3-9beb-f7ac77766a06 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:45.308479 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d566edf-04da-4ef3-9beb-f7ac77766a06 None admin] PATH_INFO: `/v3/roles` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:45.309248 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d566edf-04da-4ef3-9beb-f7ac77766a06 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:37:45.309562 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d566edf-04da-4ef3-9beb-f7ac77766a06 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:37:45.311239 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d566edf-04da-4ef3-9beb-f7ac77766a06 None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:37:45.324872 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 126/259] 10.222.0.93 () {56 vars in 1111 bytes} [Tue Jul 26 14:37:45 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:37:45.331267 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d566edf-04da-4ef3-9beb-f7ac77766a06 None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:37:45.374416 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7a3ceb-5546-4df6-9563-54606eca1fff None None] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:37:45.501716 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8494be13-c5ce-4800-b357-cb9ab72499b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:37:45.502846 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8494be13-c5ce-4800-b357-cb9ab72499b9 None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:45.503338 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8494be13-c5ce-4800-b357-cb9ab72499b9 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:45.503810 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8494be13-c5ce-4800-b357-cb9ab72499b9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:45.524915 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8494be13-c5ce-4800-b357-cb9ab72499b9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 14:37:45.535283 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application [None req-8494be13-c5ce-4800-b357-cb9ab72499b9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 14:37:45.535283 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:37:45.535283 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:37:45.535283 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:37:45.535283 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:37:45.535283 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:37:45.535283 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:37:45.535283 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:37:45.535283 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:37:45.535283 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:37:45.535283 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:37:45.535283 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:37:45.535283 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 14:37:45.535283 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 14:37:45.535283 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 14:37:45.535283 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 14:37:45.536222 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 14:37:45.536222 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 14:37:45.536222 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 14:37:45.536222 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 14:37:45.536222 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:37:45.536222 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:37:45.536222 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:37:45.536222 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:37:45.536222 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:37:45.536222 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:37:45.536222 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:37:45.536222 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application with Lock( Jul 26 14:37:45.536222 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:37:45.536222 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:37:45.536222 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:37:45.536222 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:37:45.537070 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:37:45.537070 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:37:45.537070 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:37:45.537070 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:37:45.537070 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 14:37:45.537070 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 14:37:45.537070 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 14:37:45.537070 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 14:37:45.537070 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 14:37:45.537070 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 14:37:45.537070 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 14:37:45.537070 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Jul 26 14:37:45.537951 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 134/260] 10.222.0.93 () {56 vars in 1096 bytes} [Tue Jul 26 14:37:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 473 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 14:37:45.548690 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8494be13-c5ce-4800-b357-cb9ab72499b9 None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:37:45.724187 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d566edf-04da-4ef3-9beb-f7ac77766a06 None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:37:45.744336 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:37:45.781374 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407dde3e-5838-41ba-b2a5-aa5c45be5522 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:37:45.782764 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407dde3e-5838-41ba-b2a5-aa5c45be5522 None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:45.784065 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407dde3e-5838-41ba-b2a5-aa5c45be5522 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:45.784347 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407dde3e-5838-41ba-b2a5-aa5c45be5522 None admin] PATH_INFO: `/v3/users/1561cf57fa494e5ab6566a7df55ad58e` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:45.786806 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407dde3e-5838-41ba-b2a5-aa5c45be5522 None admin] RBAC: Authorizing `identity:get_user(user_id=1561cf57fa494e5ab6566a7df55ad58e)` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:37:45.788361 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407dde3e-5838-41ba-b2a5-aa5c45be5522 None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:37:45.790886 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 127/261] 10.222.0.93 () {56 vars in 1177 bytes} [Tue Jul 26 14:37:45 2022] GET /identity/v3/users/1561cf57fa494e5ab6566a7df55ad58e => generated 283 bytes in 460 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:37:45.807969 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407dde3e-5838-41ba-b2a5-aa5c45be5522 None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:37:45.836027 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:37:45.845236 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8494be13-c5ce-4800-b357-cb9ab72499b9 None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:37:45.886688 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31670ef-1eae-421f-8cae-679fd6ab9ebb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:37:45.887344 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31670ef-1eae-421f-8cae-679fd6ab9ebb None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:45.887690 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31670ef-1eae-421f-8cae-679fd6ab9ebb None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:45.887983 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31670ef-1eae-421f-8cae-679fd6ab9ebb None admin] PATH_INFO: `/v3/roles` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:45.888733 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31670ef-1eae-421f-8cae-679fd6ab9ebb None admin] RBAC: Adding query filter params (name=admin) {{(pid=87056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:37:45.889056 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31670ef-1eae-421f-8cae-679fd6ab9ebb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:37:45.891648 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31670ef-1eae-421f-8cae-679fd6ab9ebb None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:37:45.902123 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 135/262] 10.222.0.93 () {56 vars in 1099 bytes} [Tue Jul 26 14:37:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 354 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:37:45.909028 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31670ef-1eae-421f-8cae-679fd6ab9ebb None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:37:46.031272 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31670ef-1eae-421f-8cae-679fd6ab9ebb None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:37:46.072849 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3caa3f-4857-4fe3-8ebb-1724753942ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:37:46.073531 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3caa3f-4857-4fe3-8ebb-1724753942ff None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:46.073890 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3caa3f-4857-4fe3-8ebb-1724753942ff None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:46.074184 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3caa3f-4857-4fe3-8ebb-1724753942ff None admin] PATH_INFO: `/v3/users/1561cf57fa494e5ab6566a7df55ad58e` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:46.075723 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3caa3f-4857-4fe3-8ebb-1724753942ff None admin] RBAC: Authorizing `identity:get_user(user_id=1561cf57fa494e5ab6566a7df55ad58e)` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:37:46.077221 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3caa3f-4857-4fe3-8ebb-1724753942ff None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:37:46.078949 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 136/263] 10.222.0.93 () {56 vars in 1177 bytes} [Tue Jul 26 14:37:45 2022] GET /identity/v3/users/1561cf57fa494e5ab6566a7df55ad58e => generated 283 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:37:46.085085 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3caa3f-4857-4fe3-8ebb-1724753942ff None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:37:46.120302 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:37:46.177242 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407dde3e-5838-41ba-b2a5-aa5c45be5522 None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:37:46.250948 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a453fea-173c-4831-8c83-13ae430ebccb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:37:46.251641 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a453fea-173c-4831-8c83-13ae430ebccb None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:46.251927 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a453fea-173c-4831-8c83-13ae430ebccb None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:46.252202 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a453fea-173c-4831-8c83-13ae430ebccb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:46.264536 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3caa3f-4857-4fe3-8ebb-1724753942ff None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:37:46.350370 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f456cb-c44c-4195-a1b7-6342b73c507d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:37:46.350946 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f456cb-c44c-4195-a1b7-6342b73c507d None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:46.351233 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f456cb-c44c-4195-a1b7-6342b73c507d None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:46.351514 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f456cb-c44c-4195-a1b7-6342b73c507d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:46.370007 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:37:46.412734 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a453fea-173c-4831-8c83-13ae430ebccb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:37:46.414456 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a453fea-173c-4831-8c83-13ae430ebccb None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:37:46.604193 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f456cb-c44c-4195-a1b7-6342b73c507d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:37:46.606123 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f456cb-c44c-4195-a1b7-6342b73c507d None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:37:46.672600 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:37:46.674877 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 128/264] 10.222.0.93 () {58 vars in 1282 bytes} [Tue Jul 26 14:37:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 868 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 14:37:46.677198 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89816ca9-8a27-474e-bea0-85927a35018a None None] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:46.677702 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89816ca9-8a27-474e-bea0-85927a35018a None None] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:46.678192 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89816ca9-8a27-474e-bea0-85927a35018a None None] PATH_INFO: `/` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:46.690688 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 129/265] 10.222.0.93 () {54 vars in 926 bytes} [Tue Jul 26 14:37:46 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:37:46.692705 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89816ca9-8a27-474e-bea0-85927a35018a None None] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:37:46.838660 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 137/266] 10.222.0.93 () {58 vars in 1282 bytes} [Tue Jul 26 14:37:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 754 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 26 14:37:46.839822 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268477a5-5ce3-4971-bdfd-f6c3020fedfd None None] REQUEST_METHOD: `POST` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:46.840114 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268477a5-5ce3-4971-bdfd-f6c3020fedfd None None] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:46.840514 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268477a5-5ce3-4971-bdfd-f6c3020fedfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:46.864206 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:37:46.868748 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.auth.core [None req-268477a5-5ce3-4971-bdfd-f6c3020fedfd None None] MFA Rules not processed for user `e5ef88cc058f425b882bcb87a1e1e75c`. Rule list: `[]` (Enabled: `True`). {{(pid=87056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:37:46.871186 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.fernet_utils [None req-268477a5-5ce3-4971-bdfd-f6c3020fedfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:37:46.891097 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89816ca9-8a27-474e-bea0-85927a35018a None None] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:37:46.932886 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278ed308-bd6b-4f9c-b572-c94ba101b9a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:37:46.934510 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278ed308-bd6b-4f9c-b572-c94ba101b9a3 None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:46.935023 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278ed308-bd6b-4f9c-b572-c94ba101b9a3 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:46.935487 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278ed308-bd6b-4f9c-b572-c94ba101b9a3 None admin] PATH_INFO: `/v3/projects/223cfb51fde24882a520cb183c0f36f8` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:46.936976 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278ed308-bd6b-4f9c-b572-c94ba101b9a3 None admin] RBAC: Authorizing `identity:get_project(project_id=223cfb51fde24882a520cb183c0f36f8)` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:37:46.938716 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278ed308-bd6b-4f9c-b572-c94ba101b9a3 None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:37:46.941214 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 130/267] 10.222.0.93 () {56 vars in 1186 bytes} [Tue Jul 26 14:37:46 2022] GET /identity/v3/projects/223cfb51fde24882a520cb183c0f36f8 => generated 302 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:37:46.942862 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8eb163-a70c-4402-b0ed-30c0e37e37a3 None None] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:46.943359 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8eb163-a70c-4402-b0ed-30c0e37e37a3 None None] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:46.943818 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8eb163-a70c-4402-b0ed-30c0e37e37a3 None None] PATH_INFO: `/` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:46.950556 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 131/268] 10.222.0.93 () {54 vars in 926 bytes} [Tue Jul 26 14:37:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:37:46.951821 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8eb163-a70c-4402-b0ed-30c0e37e37a3 None None] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:37:46.952076 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 138/269] 10.222.0.93 () {58 vars in 1023 bytes} [Tue Jul 26 14:37:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 14:37:46.954643 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268477a5-5ce3-4971-bdfd-f6c3020fedfd None None] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:37:47.057333 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:37:47.087518 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8eb163-a70c-4402-b0ed-30c0e37e37a3 None None] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:37:47.122077 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268477a5-5ce3-4971-bdfd-f6c3020fedfd None None] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:37:47.128176 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba0a71b-e132-4c02-93a1-e38ae025087b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:37:47.129235 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba0a71b-e132-4c02-93a1-e38ae025087b None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:47.129714 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba0a71b-e132-4c02-93a1-e38ae025087b None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:47.130189 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba0a71b-e132-4c02-93a1-e38ae025087b None admin] PATH_INFO: `/v3/projects/223cfb51fde24882a520cb183c0f36f8` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:47.131937 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba0a71b-e132-4c02-93a1-e38ae025087b None admin] RBAC: Authorizing `identity:get_project(project_id=223cfb51fde24882a520cb183c0f36f8)` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:37:47.134596 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba0a71b-e132-4c02-93a1-e38ae025087b None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:37:47.141969 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 132/270] 10.222.0.93 () {56 vars in 1186 bytes} [Tue Jul 26 14:37:46 2022] GET /identity/v3/projects/223cfb51fde24882a520cb183c0f36f8 => generated 302 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:37:47.143774 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1eda79-ef60-480e-918e-0fd0cb7b01ab None None] REQUEST_METHOD: `POST` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:47.144284 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1eda79-ef60-480e-918e-0fd0cb7b01ab None None] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:47.144775 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1eda79-ef60-480e-918e-0fd0cb7b01ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:47.164717 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1204a3dd-871c-4a7a-98fc-644bf1ad647a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:37:47.165362 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1204a3dd-871c-4a7a-98fc-644bf1ad647a None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:47.165685 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1204a3dd-871c-4a7a-98fc-644bf1ad647a None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:47.165966 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1204a3dd-871c-4a7a-98fc-644bf1ad647a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:47.166363 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.auth.core [None req-de1eda79-ef60-480e-918e-0fd0cb7b01ab None None] MFA Rules not processed for user `e5ef88cc058f425b882bcb87a1e1e75c`. Rule list: `[]` (Enabled: `True`). {{(pid=87055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:37:47.166827 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1204a3dd-871c-4a7a-98fc-644bf1ad647a None admin] RBAC: Adding query filter params (role.id=ef1a806f8d774452a6536b57a4670ceb, scope.project.id=223cfb51fde24882a520cb183c0f36f8, user.id=1561cf57fa494e5ab6566a7df55ad58e) {{(pid=87056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:37:47.167186 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1204a3dd-871c-4a7a-98fc-644bf1ad647a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:37:47.168275 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.fernet_utils [None req-de1eda79-ef60-480e-918e-0fd0cb7b01ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:37:47.168742 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1204a3dd-871c-4a7a-98fc-644bf1ad647a None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:37:47.176110 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 139/271] 10.222.0.93 () {56 vars in 1374 bytes} [Tue Jul 26 14:37:46 2022] GET /identity/v3/role_assignments?user.id=1561cf57fa494e5ab6566a7df55ad58e&scope.project.id=223cfb51fde24882a520cb183c0f36f8&role.id=ef1a806f8d774452a6536b57a4670ceb => generated 608 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:37:47.176992 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1204a3dd-871c-4a7a-98fc-644bf1ad647a None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:37:47.178444 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:37:47.293788 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 133/272] 10.222.0.93 () {58 vars in 1023 bytes} [Tue Jul 26 14:37:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 14:37:47.294750 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1eda79-ef60-480e-918e-0fd0cb7b01ab None None] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:37:47.307783 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1204a3dd-871c-4a7a-98fc-644bf1ad647a None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:37:47.334063 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:37:47.353119 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c5e116-77b6-4140-974b-3755fe463a70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:37:47.354210 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c5e116-77b6-4140-974b-3755fe463a70 None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:47.354755 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c5e116-77b6-4140-974b-3755fe463a70 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:47.355284 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c5e116-77b6-4140-974b-3755fe463a70 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:47.357058 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c5e116-77b6-4140-974b-3755fe463a70 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:37:47.358971 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c5e116-77b6-4140-974b-3755fe463a70 None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:37:47.361329 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 140/273] 10.222.0.93 () {56 vars in 1108 bytes} [Tue Jul 26 14:37:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:37:47.367119 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c5e116-77b6-4140-974b-3755fe463a70 None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:37:47.466422 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1eda79-ef60-480e-918e-0fd0cb7b01ab None None] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:37:47.507192 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6422608e-78c9-4efa-b5c7-b4ee04617fda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:37:47.507192 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6422608e-78c9-4efa-b5c7-b4ee04617fda None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:47.508503 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6422608e-78c9-4efa-b5c7-b4ee04617fda None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:47.509005 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6422608e-78c9-4efa-b5c7-b4ee04617fda None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:47.510804 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6422608e-78c9-4efa-b5c7-b4ee04617fda None admin] RBAC: Adding query filter params (role.id=94e105ff8ee4486abd501415cc05ba38, scope.project.id=223cfb51fde24882a520cb183c0f36f8, user.id=1561cf57fa494e5ab6566a7df55ad58e) {{(pid=87055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:37:47.510804 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6422608e-78c9-4efa-b5c7-b4ee04617fda None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:37:47.511839 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6422608e-78c9-4efa-b5c7-b4ee04617fda None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:37:47.526815 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 134/274] 10.222.0.93 () {56 vars in 1374 bytes} [Tue Jul 26 14:37:47 2022] GET /identity/v3/role_assignments?user.id=1561cf57fa494e5ab6566a7df55ad58e&scope.project.id=223cfb51fde24882a520cb183c0f36f8&role.id=94e105ff8ee4486abd501415cc05ba38 => generated 608 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:37:47.527843 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6422608e-78c9-4efa-b5c7-b4ee04617fda None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:37:47.545446 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:37:47.554792 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c5e116-77b6-4140-974b-3755fe463a70 None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:37:47.600554 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c709a0-8d02-4989-bb87-ed8deb7254ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:37:47.601639 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c709a0-8d02-4989-bb87-ed8deb7254ef None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:47.602768 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c709a0-8d02-4989-bb87-ed8deb7254ef None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:47.603252 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c709a0-8d02-4989-bb87-ed8deb7254ef None admin] PATH_INFO: `/v3/roles/member` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:47.617517 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c709a0-8d02-4989-bb87-ed8deb7254ef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 14:37:47.631016 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application [None req-31c709a0-8d02-4989-bb87-ed8deb7254ef None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 26 14:37:47.631016 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:37:47.631016 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:37:47.631016 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:37:47.631016 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:37:47.631016 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:37:47.631016 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:37:47.631016 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:37:47.631016 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:37:47.631016 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:37:47.631016 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:37:47.631016 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:37:47.631016 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 14:37:47.631016 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 14:37:47.631016 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 14:37:47.631016 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 14:37:47.632653 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 14:37:47.632653 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 14:37:47.632653 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 14:37:47.632653 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 14:37:47.632653 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:37:47.632653 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:37:47.632653 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:37:47.632653 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:37:47.632653 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:37:47.632653 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:37:47.632653 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:37:47.632653 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application with Lock( Jul 26 14:37:47.632653 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:37:47.632653 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:37:47.632653 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:37:47.632653 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:37:47.634576 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:37:47.634576 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:37:47.634576 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:37:47.634576 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:37:47.634576 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 14:37:47.634576 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 14:37:47.634576 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 14:37:47.634576 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 14:37:47.634576 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 14:37:47.634576 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 14:37:47.634576 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 26 14:37:47.634576 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Jul 26 14:37:47.638195 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 141/275] 10.222.0.93 () {56 vars in 1099 bytes} [Tue Jul 26 14:37:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:37:47.663827 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c709a0-8d02-4989-bb87-ed8deb7254ef None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:37:47.705702 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6422608e-78c9-4efa-b5c7-b4ee04617fda None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:37:47.756944 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dabb452-54dd-4267-85e9-0361b82e6e35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:37:47.757928 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dabb452-54dd-4267-85e9-0361b82e6e35 None admin] REQUEST_METHOD: `POST` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:47.759414 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dabb452-54dd-4267-85e9-0361b82e6e35 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:47.759994 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dabb452-54dd-4267-85e9-0361b82e6e35 None admin] PATH_INFO: `/v3/users` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:47.761423 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dabb452-54dd-4267-85e9-0361b82e6e35 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:37:47.764500 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dabb452-54dd-4267-85e9-0361b82e6e35 None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:37:47.794791 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:37:47.883077 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 135/276] 10.222.0.93 () {60 vars in 1132 bytes} [Tue Jul 26 14:37:47 2022] POST /identity/v3/users => generated 293 bytes in 356 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 14:37:47.884620 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7cf15a-70f0-4154-b712-a7fa5e5f96b8 None None] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:47.884915 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7cf15a-70f0-4154-b712-a7fa5e5f96b8 None None] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:47.885197 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7cf15a-70f0-4154-b712-a7fa5e5f96b8 None None] PATH_INFO: `/` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:47.886964 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 136/277] 10.222.0.93 () {54 vars in 926 bytes} [Tue Jul 26 14:37:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:37:47.896394 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e4d937-d283-4837-a857-21920a6b0797 None None] REQUEST_METHOD: `POST` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:47.901436 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e4d937-d283-4837-a857-21920a6b0797 None None] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:47.901436 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e4d937-d283-4837-a857-21920a6b0797 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:47.912330 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c709a0-8d02-4989-bb87-ed8deb7254ef None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:37:47.942834 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.auth.core [None req-16e4d937-d283-4837-a857-21920a6b0797 None None] MFA Rules not processed for user `e5ef88cc058f425b882bcb87a1e1e75c`. Rule list: `[]` (Enabled: `True`). {{(pid=87055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:37:47.944974 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.fernet_utils [None req-16e4d937-d283-4837-a857-21920a6b0797 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:37:47.981203 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1db192-8ac1-4242-848d-7e50885d327a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:37:47.981860 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1db192-8ac1-4242-848d-7e50885d327a None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:47.982149 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1db192-8ac1-4242-848d-7e50885d327a None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:47.983339 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1db192-8ac1-4242-848d-7e50885d327a None admin] PATH_INFO: `/v3/roles` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:47.987052 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1db192-8ac1-4242-848d-7e50885d327a None admin] RBAC: Adding query filter params (name=member) {{(pid=87056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:37:47.987452 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1db192-8ac1-4242-848d-7e50885d327a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:37:47.988880 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1db192-8ac1-4242-848d-7e50885d327a None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:37:48.002832 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 142/278] 10.222.0.93 () {56 vars in 1101 bytes} [Tue Jul 26 14:37:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 340 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:37:48.013884 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1db192-8ac1-4242-848d-7e50885d327a None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:37:48.067302 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:37:48.081626 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 137/279] 10.222.0.93 () {58 vars in 1023 bytes} [Tue Jul 26 14:37:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 14:37:48.104027 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2cc835-9eff-4d32-aafc-fbe5ad77f53a None None] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:48.104027 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2cc835-9eff-4d32-aafc-fbe5ad77f53a None None] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:48.104027 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2cc835-9eff-4d32-aafc-fbe5ad77f53a None None] PATH_INFO: `/` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:48.104027 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 138/280] 10.222.0.93 () {54 vars in 926 bytes} [Tue Jul 26 14:37:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:37:48.104027 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580b032e-f1fa-423b-a5a0-d9471506a30a None None] REQUEST_METHOD: `POST` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:48.104027 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580b032e-f1fa-423b-a5a0-d9471506a30a None None] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:48.104822 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580b032e-f1fa-423b-a5a0-d9471506a30a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:48.128798 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.auth.core [None req-580b032e-f1fa-423b-a5a0-d9471506a30a None None] MFA Rules not processed for user `e5ef88cc058f425b882bcb87a1e1e75c`. Rule list: `[]` (Enabled: `True`). {{(pid=87055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:37:48.132438 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.fernet_utils [None req-580b032e-f1fa-423b-a5a0-d9471506a30a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:37:48.187092 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1db192-8ac1-4242-848d-7e50885d327a None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:37:48.198885 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:37:48.231881 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073f2cf6-3e4b-494c-835b-9bfd32819783 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:37:48.232652 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073f2cf6-3e4b-494c-835b-9bfd32819783 None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:48.232945 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073f2cf6-3e4b-494c-835b-9bfd32819783 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:48.233223 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073f2cf6-3e4b-494c-835b-9bfd32819783 None admin] PATH_INFO: `/v3/users/a92c7220a8c84950b63d6fa4ccd4a549` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:48.251550 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 139/281] 10.222.0.93 () {58 vars in 1023 bytes} [Tue Jul 26 14:37:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 14:37:48.252312 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580b032e-f1fa-423b-a5a0-d9471506a30a None None] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:37:48.256002 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073f2cf6-3e4b-494c-835b-9bfd32819783 None admin] RBAC: Authorizing `identity:get_user(user_id=a92c7220a8c84950b63d6fa4ccd4a549)` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:37:48.259092 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073f2cf6-3e4b-494c-835b-9bfd32819783 None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:37:48.266442 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 143/282] 10.222.0.93 () {56 vars in 1177 bytes} [Tue Jul 26 14:37:48 2022] GET /identity/v3/users/a92c7220a8c84950b63d6fa4ccd4a549 => generated 293 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:37:48.269428 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073f2cf6-3e4b-494c-835b-9bfd32819783 None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:37:48.443641 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073f2cf6-3e4b-494c-835b-9bfd32819783 None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:37:48.451420 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580b032e-f1fa-423b-a5a0-d9471506a30a None None] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:37:48.500716 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:37:48.514481 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71aa0fa6-02a2-4ccf-b03b-1472880fede2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:37:48.515584 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71aa0fa6-02a2-4ccf-b03b-1472880fede2 None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:48.516070 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71aa0fa6-02a2-4ccf-b03b-1472880fede2 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:48.516615 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71aa0fa6-02a2-4ccf-b03b-1472880fede2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:48.518053 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71aa0fa6-02a2-4ccf-b03b-1472880fede2 None admin] RBAC: Adding query filter params (role.id=8b8a4a451dc84c17bba824b2ff9cc4fe, user.id=a92c7220a8c84950b63d6fa4ccd4a549, scope.system=all) {{(pid=87056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:37:48.518632 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71aa0fa6-02a2-4ccf-b03b-1472880fede2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:37:48.521456 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71aa0fa6-02a2-4ccf-b03b-1472880fede2 None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:37:48.529258 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ea750b-3631-4677-a97d-ce2288fb1316 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:37:48.530937 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ea750b-3631-4677-a97d-ce2288fb1316 None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:48.532254 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ea750b-3631-4677-a97d-ce2288fb1316 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:48.538281 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 144/283] 10.222.0.93 () {56 vars in 1308 bytes} [Tue Jul 26 14:37:48 2022] GET /identity/v3/role_assignments?user.id=a92c7220a8c84950b63d6fa4ccd4a549&scope.system=all&role.id=8b8a4a451dc84c17bba824b2ff9cc4fe => generated 226 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:37:48.538281 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71aa0fa6-02a2-4ccf-b03b-1472880fede2 None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:37:48.539704 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ea750b-3631-4677-a97d-ce2288fb1316 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:48.578688 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ea750b-3631-4677-a97d-ce2288fb1316 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 14:37:48.593629 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application [None req-f0ea750b-3631-4677-a97d-ce2288fb1316 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 26 14:37:48.593629 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:37:48.593629 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:37:48.593629 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:37:48.593629 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:37:48.593629 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:37:48.593629 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:37:48.593629 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:37:48.593629 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:37:48.593629 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:37:48.593629 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:37:48.593629 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:37:48.593629 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 14:37:48.593629 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 14:37:48.593629 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 14:37:48.593629 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 14:37:48.595247 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 14:37:48.595247 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 14:37:48.595247 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 14:37:48.595247 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 14:37:48.595247 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:37:48.595247 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:37:48.595247 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:37:48.595247 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:37:48.595247 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:37:48.595247 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:37:48.595247 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:37:48.595247 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application with Lock( Jul 26 14:37:48.595247 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:37:48.595247 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:37:48.595247 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:37:48.595247 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:37:48.596705 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:37:48.596705 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:37:48.596705 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:37:48.596705 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:37:48.596705 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 14:37:48.596705 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 14:37:48.596705 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 14:37:48.596705 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 14:37:48.596705 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 14:37:48.596705 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 14:37:48.596705 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 26 14:37:48.596705 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Jul 26 14:37:48.606790 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 140/284] 10.222.0.93 () {56 vars in 1099 bytes} [Tue Jul 26 14:37:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 350 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:37:48.610044 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:37:48.615823 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ea750b-3631-4677-a97d-ce2288fb1316 None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:37:48.729610 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71aa0fa6-02a2-4ccf-b03b-1472880fede2 None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:37:48.773264 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3898bc-d2ce-42e8-9115-0a0d22191839 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:37:48.773982 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3898bc-d2ce-42e8-9115-0a0d22191839 None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:48.774358 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3898bc-d2ce-42e8-9115-0a0d22191839 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:48.774900 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3898bc-d2ce-42e8-9115-0a0d22191839 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:48.788617 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3898bc-d2ce-42e8-9115-0a0d22191839 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 14:37:48.793977 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application [None req-ab3898bc-d2ce-42e8-9115-0a0d22191839 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 26 14:37:48.793977 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:37:48.793977 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:37:48.793977 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:37:48.793977 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:37:48.793977 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:37:48.793977 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:37:48.793977 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:37:48.793977 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:37:48.793977 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:37:48.793977 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:37:48.793977 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:37:48.793977 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 14:37:48.793977 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 14:37:48.793977 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 14:37:48.793977 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 14:37:48.795587 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 14:37:48.795587 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 14:37:48.795587 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 14:37:48.795587 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 14:37:48.795587 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:37:48.795587 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:37:48.795587 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:37:48.795587 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:37:48.795587 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:37:48.795587 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:37:48.795587 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:37:48.795587 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application with Lock( Jul 26 14:37:48.795587 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:37:48.795587 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:37:48.795587 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:37:48.795587 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:37:48.797359 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:37:48.797359 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:37:48.797359 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:37:48.797359 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:37:48.797359 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 14:37:48.797359 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 14:37:48.797359 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 14:37:48.797359 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 14:37:48.797359 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 14:37:48.797359 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 14:37:48.797359 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 26 14:37:48.797359 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Jul 26 14:37:48.797359 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 145/285] 10.222.0.93 () {56 vars in 1099 bytes} [Tue Jul 26 14:37:48 2022] GET /identity/v3/roles/reader => generated 84 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:37:48.807586 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3898bc-d2ce-42e8-9115-0a0d22191839 None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:37:48.910375 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ea750b-3631-4677-a97d-ce2288fb1316 None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:37:48.994648 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0353fb2b-58b4-4485-896c-ac04e606ed0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:37:48.996025 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0353fb2b-58b4-4485-896c-ac04e606ed0b None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:48.996728 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0353fb2b-58b4-4485-896c-ac04e606ed0b None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:48.997418 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0353fb2b-58b4-4485-896c-ac04e606ed0b None admin] PATH_INFO: `/v3/roles` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:48.998838 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0353fb2b-58b4-4485-896c-ac04e606ed0b None admin] RBAC: Adding query filter params (name=member) {{(pid=87055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:37:48.999572 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0353fb2b-58b4-4485-896c-ac04e606ed0b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:37:49.002070 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0353fb2b-58b4-4485-896c-ac04e606ed0b None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:37:49.020284 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 141/286] 10.222.0.93 () {56 vars in 1101 bytes} [Tue Jul 26 14:37:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 406 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:37:49.043383 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0353fb2b-58b4-4485-896c-ac04e606ed0b None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:37:49.066759 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:37:49.078828 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3898bc-d2ce-42e8-9115-0a0d22191839 None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:37:49.136406 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7a1912-e484-483e-aae1-b2447aa26285 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:37:49.137417 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7a1912-e484-483e-aae1-b2447aa26285 None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:49.137929 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7a1912-e484-483e-aae1-b2447aa26285 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:49.138429 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7a1912-e484-483e-aae1-b2447aa26285 None admin] PATH_INFO: `/v3/roles` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:49.139388 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7a1912-e484-483e-aae1-b2447aa26285 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:37:49.139969 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7a1912-e484-483e-aae1-b2447aa26285 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:37:49.141911 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7a1912-e484-483e-aae1-b2447aa26285 None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:37:49.179864 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 146/287] 10.222.0.93 () {56 vars in 1101 bytes} [Tue Jul 26 14:37:48 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 373 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:37:49.194745 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7a1912-e484-483e-aae1-b2447aa26285 None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:37:49.196406 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:37:49.304727 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0353fb2b-58b4-4485-896c-ac04e606ed0b None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:37:49.381093 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd481c5-5033-46f6-9dd6-c956b9a0aef0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:37:49.382198 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd481c5-5033-46f6-9dd6-c956b9a0aef0 None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:49.382728 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd481c5-5033-46f6-9dd6-c956b9a0aef0 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:49.383684 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd481c5-5033-46f6-9dd6-c956b9a0aef0 None admin] PATH_INFO: `/v3/users/756f8f779082446faa20e302010bf17c` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:49.387761 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd481c5-5033-46f6-9dd6-c956b9a0aef0 None admin] RBAC: Authorizing `identity:get_user(user_id=756f8f779082446faa20e302010bf17c)` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:37:49.390765 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd481c5-5033-46f6-9dd6-c956b9a0aef0 None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:37:49.394018 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 142/288] 10.222.0.93 () {56 vars in 1177 bytes} [Tue Jul 26 14:37:49 2022] GET /identity/v3/users/756f8f779082446faa20e302010bf17c => generated 297 bytes in 352 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:37:49.403150 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd481c5-5033-46f6-9dd6-c956b9a0aef0 None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:37:49.537783 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7a1912-e484-483e-aae1-b2447aa26285 None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:37:49.600963 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd481c5-5033-46f6-9dd6-c956b9a0aef0 None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:37:49.617221 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:37:49.623775 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ea0925-fbed-48ec-8d4c-4ac9301014de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:37:49.624900 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ea0925-fbed-48ec-8d4c-4ac9301014de None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:49.625403 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ea0925-fbed-48ec-8d4c-4ac9301014de None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:49.625882 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ea0925-fbed-48ec-8d4c-4ac9301014de None admin] PATH_INFO: `/v3/users/885a2a4652614d04a7c831bab4159c0e` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:49.627532 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ea0925-fbed-48ec-8d4c-4ac9301014de None admin] RBAC: Authorizing `identity:get_user(user_id=885a2a4652614d04a7c831bab4159c0e)` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:37:49.629330 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ea0925-fbed-48ec-8d4c-4ac9301014de None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:37:49.631555 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 147/289] 10.222.0.93 () {56 vars in 1177 bytes} [Tue Jul 26 14:37:49 2022] GET /identity/v3/users/885a2a4652614d04a7c831bab4159c0e => generated 297 bytes in 438 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:37:49.640350 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ea0925-fbed-48ec-8d4c-4ac9301014de None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:37:49.659843 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669e25e5-c716-4cd6-b922-8b94ec44d9c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:37:49.659843 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669e25e5-c716-4cd6-b922-8b94ec44d9c3 None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:49.659843 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669e25e5-c716-4cd6-b922-8b94ec44d9c3 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:49.659843 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669e25e5-c716-4cd6-b922-8b94ec44d9c3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:49.716418 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:37:49.752059 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669e25e5-c716-4cd6-b922-8b94ec44d9c3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:37:49.754844 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669e25e5-c716-4cd6-b922-8b94ec44d9c3 None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:37:49.886542 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 143/290] 10.222.0.93 () {58 vars in 1282 bytes} [Tue Jul 26 14:37:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 484 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 14:37:49.894891 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669e25e5-c716-4cd6-b922-8b94ec44d9c3 None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:37:49.918930 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:37:49.978384 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ea0925-fbed-48ec-8d4c-4ac9301014de None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:37:50.023505 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669e25e5-c716-4cd6-b922-8b94ec44d9c3 None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:37:50.075539 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2267d71b-18dd-4262-965f-00c695bfd10a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:37:50.076545 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2267d71b-18dd-4262-965f-00c695bfd10a None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:50.076978 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2267d71b-18dd-4262-965f-00c695bfd10a None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:50.077403 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2267d71b-18dd-4262-965f-00c695bfd10a None admin] PATH_INFO: `/v3/projects/223cfb51fde24882a520cb183c0f36f8` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:50.078991 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2267d71b-18dd-4262-965f-00c695bfd10a None admin] RBAC: Authorizing `identity:get_project(project_id=223cfb51fde24882a520cb183c0f36f8)` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:37:50.080721 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2267d71b-18dd-4262-965f-00c695bfd10a None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:37:50.082774 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 144/291] 10.222.0.93 () {56 vars in 1186 bytes} [Tue Jul 26 14:37:49 2022] GET /identity/v3/projects/223cfb51fde24882a520cb183c0f36f8 => generated 302 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:37:50.089683 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe330d1-1a10-4776-882d-c8ca45a999ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:37:50.091018 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe330d1-1a10-4776-882d-c8ca45a999ee None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:50.091431 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2267d71b-18dd-4262-965f-00c695bfd10a None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:37:50.091741 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe330d1-1a10-4776-882d-c8ca45a999ee None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:50.092353 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe330d1-1a10-4776-882d-c8ca45a999ee None admin] PATH_INFO: `/v3/projects/223cfb51fde24882a520cb183c0f36f8` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:50.095229 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe330d1-1a10-4776-882d-c8ca45a999ee None admin] RBAC: Authorizing `identity:get_project(project_id=223cfb51fde24882a520cb183c0f36f8)` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:37:50.098237 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe330d1-1a10-4776-882d-c8ca45a999ee None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:37:50.105028 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 148/292] 10.222.0.93 () {56 vars in 1186 bytes} [Tue Jul 26 14:37:49 2022] GET /identity/v3/projects/223cfb51fde24882a520cb183c0f36f8 => generated 302 bytes in 465 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:37:50.112452 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe330d1-1a10-4776-882d-c8ca45a999ee None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:37:50.392052 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:37:50.447021 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:37:50.459011 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2267d71b-18dd-4262-965f-00c695bfd10a None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:37:50.486830 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe330d1-1a10-4776-882d-c8ca45a999ee None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:37:50.567033 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e11b54-b4aa-45ba-ad61-1e3b8abdc2ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:37:50.568553 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e11b54-b4aa-45ba-ad61-1e3b8abdc2ac None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:50.569313 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e11b54-b4aa-45ba-ad61-1e3b8abdc2ac None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:50.570038 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e11b54-b4aa-45ba-ad61-1e3b8abdc2ac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:50.572537 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e11b54-b4aa-45ba-ad61-1e3b8abdc2ac None admin] RBAC: Adding query filter params (role.id=8b8a4a451dc84c17bba824b2ff9cc4fe, scope.project.id=223cfb51fde24882a520cb183c0f36f8, user.id=756f8f779082446faa20e302010bf17c) {{(pid=87055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:37:50.573423 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e11b54-b4aa-45ba-ad61-1e3b8abdc2ac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:37:50.576449 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e11b54-b4aa-45ba-ad61-1e3b8abdc2ac None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:37:50.593055 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 145/293] 10.222.0.93 () {56 vars in 1374 bytes} [Tue Jul 26 14:37:50 2022] GET /identity/v3/role_assignments?user.id=756f8f779082446faa20e302010bf17c&scope.project.id=223cfb51fde24882a520cb183c0f36f8&role.id=8b8a4a451dc84c17bba824b2ff9cc4fe => generated 608 bytes in 503 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:37:50.603660 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3180b30d-f0ac-4ea9-be34-1dfe5a4d97f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:37:50.604803 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3180b30d-f0ac-4ea9-be34-1dfe5a4d97f4 None admin] REQUEST_METHOD: `PUT` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:50.605294 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3180b30d-f0ac-4ea9-be34-1dfe5a4d97f4 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:50.605784 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3180b30d-f0ac-4ea9-be34-1dfe5a4d97f4 None admin] PATH_INFO: `/v3/projects/223cfb51fde24882a520cb183c0f36f8/users/885a2a4652614d04a7c831bab4159c0e/roles/8b206d8d963645f6bd492384b6c5d39f` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:50.609660 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3180b30d-f0ac-4ea9-be34-1dfe5a4d97f4 None admin] RBAC: Authorizing `identity:create_grant(project_id=223cfb51fde24882a520cb183c0f36f8, user_id=885a2a4652614d04a7c831bab4159c0e, role_id=8b206d8d963645f6bd492384b6c5d39f)` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:37:50.612532 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3180b30d-f0ac-4ea9-be34-1dfe5a4d97f4 None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:37:50.704666 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 149/294] 10.222.0.93 () {58 vars in 1439 bytes} [Tue Jul 26 14:37:50 2022] PUT /identity/v3/projects/223cfb51fde24882a520cb183c0f36f8/users/885a2a4652614d04a7c831bab4159c0e/roles/8b206d8d963645f6bd492384b6c5d39f => generated 0 bytes in 594 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 14:37:50.982787 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c269c8-7deb-4dbb-809b-87c15b489a3d None None] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:50.983607 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c269c8-7deb-4dbb-809b-87c15b489a3d None None] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:50.984295 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c269c8-7deb-4dbb-809b-87c15b489a3d None None] PATH_INFO: `/` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:50.987079 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 146/295] 10.222.0.93 () {54 vars in 926 bytes} [Tue Jul 26 14:37:50 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:37:50.994147 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12c62fb-35f9-4d5f-b5e7-d79d4c610bd6 None None] REQUEST_METHOD: `POST` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:50.994582 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12c62fb-35f9-4d5f-b5e7-d79d4c610bd6 None None] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:50.994800 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12c62fb-35f9-4d5f-b5e7-d79d4c610bd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:51.030384 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.auth.core [None req-b12c62fb-35f9-4d5f-b5e7-d79d4c610bd6 None None] MFA Rules not processed for user `e5ef88cc058f425b882bcb87a1e1e75c`. Rule list: `[]` (Enabled: `True`). {{(pid=87056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:37:51.031524 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.fernet_utils [None req-b12c62fb-35f9-4d5f-b5e7-d79d4c610bd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:37:51.132688 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 150/296] 10.222.0.93 () {58 vars in 1023 bytes} [Tue Jul 26 14:37:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 14:37:51.172443 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c269c8-7deb-4dbb-809b-87c15b489a3d None None] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:37:51.288686 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e637bc33-98c3-4bf7-8648-d7e83563deb2 None None] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:51.289822 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e637bc33-98c3-4bf7-8648-d7e83563deb2 None None] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:51.290460 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e637bc33-98c3-4bf7-8648-d7e83563deb2 None None] PATH_INFO: `/` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:51.293433 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 151/297] 10.222.0.93 () {54 vars in 926 bytes} [Tue Jul 26 14:37:51 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 14:37:51.302115 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e6fdf1-5528-48b9-a2f8-7c364866a339 None None] REQUEST_METHOD: `POST` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:51.302774 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e6fdf1-5528-48b9-a2f8-7c364866a339 None None] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:51.303361 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e6fdf1-5528-48b9-a2f8-7c364866a339 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:51.348179 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.auth.core [None req-96e6fdf1-5528-48b9-a2f8-7c364866a339 None None] MFA Rules not processed for user `e5ef88cc058f425b882bcb87a1e1e75c`. Rule list: `[]` (Enabled: `True`). {{(pid=87056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:37:51.350378 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.fernet_utils [None req-96e6fdf1-5528-48b9-a2f8-7c364866a339 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:37:51.400291 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c269c8-7deb-4dbb-809b-87c15b489a3d None None] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:37:51.455983 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726413e8-9aa0-4fae-b41c-ae7868e16790 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:37:51.456899 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726413e8-9aa0-4fae-b41c-ae7868e16790 None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:51.457333 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726413e8-9aa0-4fae-b41c-ae7868e16790 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:51.457759 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726413e8-9aa0-4fae-b41c-ae7868e16790 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:51.471620 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726413e8-9aa0-4fae-b41c-ae7868e16790 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 14:37:51.477069 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application [None req-726413e8-9aa0-4fae-b41c-ae7868e16790 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 26 14:37:51.477069 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:37:51.477069 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:37:51.477069 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:37:51.477069 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:37:51.477069 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:37:51.477069 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:37:51.477069 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:37:51.477069 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:37:51.477069 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:37:51.477069 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:37:51.477069 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:37:51.477069 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 14:37:51.477069 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 14:37:51.477069 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 14:37:51.477069 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 14:37:51.478066 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 14:37:51.478066 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 14:37:51.478066 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 14:37:51.478066 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 14:37:51.478066 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:37:51.478066 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:37:51.478066 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:37:51.478066 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:37:51.478066 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:37:51.478066 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:37:51.478066 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:37:51.478066 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application with Lock( Jul 26 14:37:51.478066 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:37:51.478066 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:37:51.478066 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:37:51.478066 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:37:51.478922 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:37:51.478922 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:37:51.478922 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:37:51.478922 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:37:51.478922 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 14:37:51.478922 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 14:37:51.478922 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 14:37:51.478922 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 14:37:51.478922 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 14:37:51.478922 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 14:37:51.478922 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 26 14:37:51.478922 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Jul 26 14:37:51.481605 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 147/298] 10.222.0.93 () {56 vars in 1099 bytes} [Tue Jul 26 14:37:51 2022] GET /identity/v3/roles/reader => generated 84 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:37:51.491743 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726413e8-9aa0-4fae-b41c-ae7868e16790 None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:37:51.496056 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 152/299] 10.222.0.93 () {58 vars in 1023 bytes} [Tue Jul 26 14:37:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 14:37:51.500716 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:37:51.534838 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e6fdf1-5528-48b9-a2f8-7c364866a339 None None] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:37:51.552189 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:37:51.668273 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726413e8-9aa0-4fae-b41c-ae7868e16790 None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:37:51.701358 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e6fdf1-5528-48b9-a2f8-7c364866a339 None None] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:37:51.724469 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d461ed34-5743-466e-91a2-7ea54a771f95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:37:51.725112 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d461ed34-5743-466e-91a2-7ea54a771f95 None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:51.725424 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d461ed34-5743-466e-91a2-7ea54a771f95 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:51.725949 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d461ed34-5743-466e-91a2-7ea54a771f95 None admin] PATH_INFO: `/v3/roles` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:51.727108 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d461ed34-5743-466e-91a2-7ea54a771f95 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:37:51.727432 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d461ed34-5743-466e-91a2-7ea54a771f95 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:37:51.729429 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d461ed34-5743-466e-91a2-7ea54a771f95 None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:37:51.742279 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 148/300] 10.222.0.93 () {56 vars in 1101 bytes} [Tue Jul 26 14:37:51 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:37:51.748476 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d461ed34-5743-466e-91a2-7ea54a771f95 None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:37:51.755386 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273c1bef-f99f-4aff-8d5a-9f0c546798b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:37:51.756073 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273c1bef-f99f-4aff-8d5a-9f0c546798b6 None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:51.756529 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273c1bef-f99f-4aff-8d5a-9f0c546798b6 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:51.756816 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273c1bef-f99f-4aff-8d5a-9f0c546798b6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:51.758832 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273c1bef-f99f-4aff-8d5a-9f0c546798b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:37:51.760629 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273c1bef-f99f-4aff-8d5a-9f0c546798b6 None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:37:51.767690 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 153/301] 10.222.0.93 () {56 vars in 1108 bytes} [Tue Jul 26 14:37:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:37:51.768944 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273c1bef-f99f-4aff-8d5a-9f0c546798b6 None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:37:51.877594 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:37:51.879218 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:37:51.928716 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273c1bef-f99f-4aff-8d5a-9f0c546798b6 None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:37:51.953420 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d461ed34-5743-466e-91a2-7ea54a771f95 None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:37:51.987836 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355d93b5-cd9c-414d-bb8c-b1f34e1ddfe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:37:51.988868 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355d93b5-cd9c-414d-bb8c-b1f34e1ddfe6 None admin] REQUEST_METHOD: `POST` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:51.989351 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355d93b5-cd9c-414d-bb8c-b1f34e1ddfe6 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:51.989826 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355d93b5-cd9c-414d-bb8c-b1f34e1ddfe6 None admin] PATH_INFO: `/v3/groups` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:51.990755 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355d93b5-cd9c-414d-bb8c-b1f34e1ddfe6 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:37:51.992720 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355d93b5-cd9c-414d-bb8c-b1f34e1ddfe6 None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:37:52.016657 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea72401-8303-4536-9089-6752e6fa560f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:37:52.017841 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea72401-8303-4536-9089-6752e6fa560f None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:52.018349 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea72401-8303-4536-9089-6752e6fa560f None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:52.019001 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea72401-8303-4536-9089-6752e6fa560f None admin] PATH_INFO: `/v3/users/34168efdd8ae4c8091a99077ad07c30b` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:52.045713 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea72401-8303-4536-9089-6752e6fa560f None admin] RBAC: Authorizing `identity:get_user(user_id=34168efdd8ae4c8091a99077ad07c30b)` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:37:52.048578 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea72401-8303-4536-9089-6752e6fa560f None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:37:52.053129 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 149/302] 10.222.0.93 () {56 vars in 1177 bytes} [Tue Jul 26 14:37:51 2022] GET /identity/v3/users/34168efdd8ae4c8091a99077ad07c30b => generated 293 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:37:52.054002 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaa62f0-ba6a-4b0a-a63c-49ac51a7d7ce None None] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:52.054510 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaa62f0-ba6a-4b0a-a63c-49ac51a7d7ce None None] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:52.055584 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaa62f0-ba6a-4b0a-a63c-49ac51a7d7ce None None] PATH_INFO: `/` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:52.062424 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 150/303] 10.222.0.93 () {54 vars in 926 bytes} [Tue Jul 26 14:37:52 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:37:52.062424 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfaa62f0-ba6a-4b0a-a63c-49ac51a7d7ce None None] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:37:52.091327 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 154/304] 10.222.0.93 () {60 vars in 1134 bytes} [Tue Jul 26 14:37:51 2022] POST /identity/v3/groups => generated 229 bytes in 323 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 14:37:52.096825 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac44831e-e3e5-4517-bc91-63ad045eff44 None None] REQUEST_METHOD: `POST` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:52.097343 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac44831e-e3e5-4517-bc91-63ad045eff44 None None] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:52.097854 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac44831e-e3e5-4517-bc91-63ad045eff44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:52.132053 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.auth.core [None req-ac44831e-e3e5-4517-bc91-63ad045eff44 None None] MFA Rules not processed for user `e5ef88cc058f425b882bcb87a1e1e75c`. Rule list: `[]` (Enabled: `True`). {{(pid=87056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:37:52.135120 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.fernet_utils [None req-ac44831e-e3e5-4517-bc91-63ad045eff44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:37:52.294598 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfaa62f0-ba6a-4b0a-a63c-49ac51a7d7ce None None] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:37:52.301029 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 155/305] 10.222.0.93 () {58 vars in 1023 bytes} [Tue Jul 26 14:37:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 14:37:52.333492 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac44831e-e3e5-4517-bc91-63ad045eff44 None None] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:37:52.340239 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:37:52.364919 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb9275c-c00b-496f-b87b-0873b552a32f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:37:52.365615 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb9275c-c00b-496f-b87b-0873b552a32f None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:52.366237 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb9275c-c00b-496f-b87b-0873b552a32f None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:52.366505 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb9275c-c00b-496f-b87b-0873b552a32f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:52.368152 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb9275c-c00b-496f-b87b-0873b552a32f None admin] RBAC: Adding query filter params (role.id=8b206d8d963645f6bd492384b6c5d39f, user.id=34168efdd8ae4c8091a99077ad07c30b, scope.system=all) {{(pid=87055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:37:52.368722 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb9275c-c00b-496f-b87b-0873b552a32f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:37:52.370366 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb9275c-c00b-496f-b87b-0873b552a32f None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:37:52.381635 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 151/306] 10.222.0.93 () {56 vars in 1308 bytes} [Tue Jul 26 14:37:52 2022] GET /identity/v3/role_assignments?user.id=34168efdd8ae4c8091a99077ad07c30b&scope.system=all&role.id=8b206d8d963645f6bd492384b6c5d39f => generated 226 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:37:52.456091 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:37:52.501004 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac44831e-e3e5-4517-bc91-63ad045eff44 None None] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:37:52.545497 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9420639e-d89b-429a-86a1-a924c0b18400 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:37:52.546179 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9420639e-d89b-429a-86a1-a924c0b18400 None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:52.546501 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9420639e-d89b-429a-86a1-a924c0b18400 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:52.546782 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9420639e-d89b-429a-86a1-a924c0b18400 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:52.561054 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9420639e-d89b-429a-86a1-a924c0b18400 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 14:37:52.566282 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application [None req-9420639e-d89b-429a-86a1-a924c0b18400 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 26 14:37:52.566282 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:37:52.566282 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:37:52.566282 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:37:52.566282 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:37:52.566282 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:37:52.566282 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:37:52.566282 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:37:52.566282 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:37:52.566282 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:37:52.566282 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:37:52.566282 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:37:52.566282 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 14:37:52.566282 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 14:37:52.566282 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 14:37:52.566282 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 14:37:52.567990 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 14:37:52.567990 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 14:37:52.567990 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 14:37:52.567990 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 14:37:52.567990 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:37:52.567990 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:37:52.567990 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:37:52.567990 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:37:52.567990 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:37:52.567990 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:37:52.567990 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:37:52.567990 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application with Lock( Jul 26 14:37:52.567990 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:37:52.567990 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:37:52.567990 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:37:52.567990 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:37:52.569436 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:37:52.569436 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:37:52.569436 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:37:52.569436 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:37:52.569436 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 14:37:52.569436 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 14:37:52.569436 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 14:37:52.569436 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 14:37:52.569436 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 14:37:52.569436 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 14:37:52.569436 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 26 14:37:52.569436 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Jul 26 14:37:52.569436 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 156/307] 10.222.0.93 () {56 vars in 1099 bytes} [Tue Jul 26 14:37:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 14:37:52.584191 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb9275c-c00b-496f-b87b-0873b552a32f None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:37:52.797950 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb9275c-c00b-496f-b87b-0873b552a32f None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:37:52.867446 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f64a8c0-8ee1-4370-b198-b681c6a09bc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:37:52.869399 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f64a8c0-8ee1-4370-b198-b681c6a09bc2 None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:52.870097 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f64a8c0-8ee1-4370-b198-b681c6a09bc2 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:52.870800 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f64a8c0-8ee1-4370-b198-b681c6a09bc2 None admin] PATH_INFO: `/v3/roles` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:52.872370 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f64a8c0-8ee1-4370-b198-b681c6a09bc2 None admin] RBAC: Adding query filter params (name=member) {{(pid=87055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:37:52.873123 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f64a8c0-8ee1-4370-b198-b681c6a09bc2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:37:52.876020 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f64a8c0-8ee1-4370-b198-b681c6a09bc2 None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:37:52.893627 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 152/308] 10.222.0.93 () {56 vars in 1101 bytes} [Tue Jul 26 14:37:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:37:52.904087 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9420639e-d89b-429a-86a1-a924c0b18400 None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:37:53.071739 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9420639e-d89b-429a-86a1-a924c0b18400 None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:37:53.106718 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:37:53.116269 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b235609a-cce7-4d60-88d9-830af6de2063 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:37:53.116928 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b235609a-cce7-4d60-88d9-830af6de2063 None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:53.117212 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b235609a-cce7-4d60-88d9-830af6de2063 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:53.117541 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b235609a-cce7-4d60-88d9-830af6de2063 None admin] PATH_INFO: `/v3/users/a92c7220a8c84950b63d6fa4ccd4a549` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:53.119182 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b235609a-cce7-4d60-88d9-830af6de2063 None admin] RBAC: Authorizing `identity:get_user(user_id=a92c7220a8c84950b63d6fa4ccd4a549)` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:37:53.120738 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b235609a-cce7-4d60-88d9-830af6de2063 None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:37:53.122859 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 157/309] 10.222.0.93 () {56 vars in 1177 bytes} [Tue Jul 26 14:37:52 2022] GET /identity/v3/users/a92c7220a8c84950b63d6fa4ccd4a549 => generated 293 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:37:53.129536 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f64a8c0-8ee1-4370-b198-b681c6a09bc2 None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:37:53.209715 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:37:53.305048 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f64a8c0-8ee1-4370-b198-b681c6a09bc2 None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:37:53.380049 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ace6300-79eb-4cc5-927e-72059a9a61e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:37:53.400610 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ace6300-79eb-4cc5-927e-72059a9a61e8 None admin] REQUEST_METHOD: `PUT` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:53.400610 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ace6300-79eb-4cc5-927e-72059a9a61e8 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:53.400610 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ace6300-79eb-4cc5-927e-72059a9a61e8 None admin] PATH_INFO: `/v3/system/users/a92c7220a8c84950b63d6fa4ccd4a549/roles/8b8a4a451dc84c17bba824b2ff9cc4fe` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:53.400610 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ace6300-79eb-4cc5-927e-72059a9a61e8 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=a92c7220a8c84950b63d6fa4ccd4a549, role_id=8b8a4a451dc84c17bba824b2ff9cc4fe)` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:37:53.400610 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ace6300-79eb-4cc5-927e-72059a9a61e8 None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:37:53.602737 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 153/310] 10.222.0.93 () {58 vars in 1334 bytes} [Tue Jul 26 14:37:53 2022] PUT /identity/v3/system/users/a92c7220a8c84950b63d6fa4ccd4a549/roles/8b8a4a451dc84c17bba824b2ff9cc4fe => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 14:37:53.895269 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4212f86-dfb6-4482-9c3a-0d197c36d89f None None] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:53.895764 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4212f86-dfb6-4482-9c3a-0d197c36d89f None None] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:53.896241 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4212f86-dfb6-4482-9c3a-0d197c36d89f None None] PATH_INFO: `/` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:53.899762 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 158/311] 10.222.0.93 () {54 vars in 926 bytes} [Tue Jul 26 14:37:53 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:37:53.909522 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2def16b7-237e-4b94-bcb2-0c93d3661189 None None] REQUEST_METHOD: `POST` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:53.910005 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2def16b7-237e-4b94-bcb2-0c93d3661189 None None] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:53.910540 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2def16b7-237e-4b94-bcb2-0c93d3661189 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:53.944232 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.auth.core [None req-2def16b7-237e-4b94-bcb2-0c93d3661189 None None] MFA Rules not processed for user `e5ef88cc058f425b882bcb87a1e1e75c`. Rule list: `[]` (Enabled: `True`). {{(pid=87055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:37:53.946877 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.fernet_utils [None req-2def16b7-237e-4b94-bcb2-0c93d3661189 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:37:54.094094 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 154/312] 10.222.0.93 () {58 vars in 1023 bytes} [Tue Jul 26 14:37:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 14:37:54.119243 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4212f86-dfb6-4482-9c3a-0d197c36d89f None None] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:37:54.299409 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4212f86-dfb6-4482-9c3a-0d197c36d89f None None] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:37:54.357002 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24008dc-fd02-4675-908b-2931f91d5e7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:37:54.358389 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24008dc-fd02-4675-908b-2931f91d5e7a None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:54.358945 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24008dc-fd02-4675-908b-2931f91d5e7a None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:54.359437 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24008dc-fd02-4675-908b-2931f91d5e7a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:54.372323 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24008dc-fd02-4675-908b-2931f91d5e7a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 14:37:54.377838 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application [None req-e24008dc-fd02-4675-908b-2931f91d5e7a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 26 14:37:54.377838 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:37:54.377838 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:37:54.377838 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:37:54.377838 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:37:54.377838 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:37:54.377838 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:37:54.377838 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:37:54.377838 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:37:54.377838 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:37:54.377838 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:37:54.377838 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:37:54.377838 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 14:37:54.377838 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 14:37:54.377838 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 14:37:54.377838 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 14:37:54.387777 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 14:37:54.387777 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 14:37:54.387777 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 14:37:54.387777 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 14:37:54.387777 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:37:54.387777 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:37:54.387777 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:37:54.387777 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:37:54.387777 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:37:54.387777 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:37:54.387777 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:37:54.387777 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application with Lock( Jul 26 14:37:54.387777 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:37:54.387777 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:37:54.387777 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:37:54.387777 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:37:54.388672 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:37:54.388672 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:37:54.388672 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:37:54.388672 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:37:54.388672 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 14:37:54.388672 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 14:37:54.388672 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 14:37:54.388672 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 14:37:54.388672 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 14:37:54.388672 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 14:37:54.388672 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 26 14:37:54.388672 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Jul 26 14:37:54.388672 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 159/313] 10.222.0.93 () {56 vars in 1099 bytes} [Tue Jul 26 14:37:54 2022] GET /identity/v3/roles/reader => generated 84 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:37:54.389324 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2def16b7-237e-4b94-bcb2-0c93d3661189 None None] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:37:54.439389 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:37:54.609738 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2def16b7-237e-4b94-bcb2-0c93d3661189 None None] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:37:54.691897 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855030a0-d68c-417c-82a2-7184471bdc86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:37:54.693001 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855030a0-d68c-417c-82a2-7184471bdc86 None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:54.693509 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855030a0-d68c-417c-82a2-7184471bdc86 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:54.694002 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855030a0-d68c-417c-82a2-7184471bdc86 None admin] PATH_INFO: `/v3/roles` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:54.695594 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855030a0-d68c-417c-82a2-7184471bdc86 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:37:54.696361 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855030a0-d68c-417c-82a2-7184471bdc86 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:37:54.699061 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855030a0-d68c-417c-82a2-7184471bdc86 None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:37:54.717787 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 155/314] 10.222.0.93 () {56 vars in 1101 bytes} [Tue Jul 26 14:37:54 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:37:54.723648 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24008dc-fd02-4675-908b-2931f91d5e7a None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:37:54.793727 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:37:54.851591 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24008dc-fd02-4675-908b-2931f91d5e7a None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:37:54.883792 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929ccb1f-5f4f-450e-95e3-1976e770c708 None None] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:54.884077 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929ccb1f-5f4f-450e-95e3-1976e770c708 None None] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:54.884264 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929ccb1f-5f4f-450e-95e3-1976e770c708 None None] PATH_INFO: `/` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:54.885969 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 156/315] 10.222.0.93 () {54 vars in 926 bytes} [Tue Jul 26 14:37:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 14:37:54.891556 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b581ec37-3d74-4a48-8fdf-7969ef576586 None None] REQUEST_METHOD: `POST` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:54.891874 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b581ec37-3d74-4a48-8fdf-7969ef576586 None None] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:54.892141 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b581ec37-3d74-4a48-8fdf-7969ef576586 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:54.895385 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8702e0-2714-4ec3-9cb0-dfe30f44a751 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:37:54.896319 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8702e0-2714-4ec3-9cb0-dfe30f44a751 None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:54.896806 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8702e0-2714-4ec3-9cb0-dfe30f44a751 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:54.897309 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8702e0-2714-4ec3-9cb0-dfe30f44a751 None admin] PATH_INFO: `/v3/users/885a2a4652614d04a7c831bab4159c0e` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:54.898888 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8702e0-2714-4ec3-9cb0-dfe30f44a751 None admin] RBAC: Authorizing `identity:get_user(user_id=885a2a4652614d04a7c831bab4159c0e)` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:37:54.901636 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8702e0-2714-4ec3-9cb0-dfe30f44a751 None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:37:54.909622 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 160/316] 10.222.0.93 () {56 vars in 1177 bytes} [Tue Jul 26 14:37:54 2022] GET /identity/v3/users/885a2a4652614d04a7c831bab4159c0e => generated 297 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:37:54.912197 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.auth.core [None req-b581ec37-3d74-4a48-8fdf-7969ef576586 None None] MFA Rules not processed for user `e5ef88cc058f425b882bcb87a1e1e75c`. Rule list: `[]` (Enabled: `True`). {{(pid=87055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:37:54.913803 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.fernet_utils [None req-b581ec37-3d74-4a48-8fdf-7969ef576586 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:37:54.915085 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8702e0-2714-4ec3-9cb0-dfe30f44a751 None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:37:54.998388 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 157/317] 10.222.0.93 () {58 vars in 1023 bytes} [Tue Jul 26 14:37:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 14:37:55.001731 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf1aac9-4742-48a1-a6e4-ea88389e293d None None] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:55.002034 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf1aac9-4742-48a1-a6e4-ea88389e293d None None] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:55.002315 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf1aac9-4742-48a1-a6e4-ea88389e293d None None] PATH_INFO: `/` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:55.003967 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 158/318] 10.222.0.93 () {54 vars in 926 bytes} [Tue Jul 26 14:37:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 14:37:55.013021 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995d7698-0f6e-4871-8eaa-09e1083f3460 None None] REQUEST_METHOD: `POST` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:55.013534 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995d7698-0f6e-4871-8eaa-09e1083f3460 None None] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:55.013813 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995d7698-0f6e-4871-8eaa-09e1083f3460 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:55.038911 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.auth.core [None req-995d7698-0f6e-4871-8eaa-09e1083f3460 None None] MFA Rules not processed for user `e5ef88cc058f425b882bcb87a1e1e75c`. Rule list: `[]` (Enabled: `True`). {{(pid=87055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:37:55.040758 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.fernet_utils [None req-995d7698-0f6e-4871-8eaa-09e1083f3460 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:37:55.086038 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:37:55.097344 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8702e0-2714-4ec3-9cb0-dfe30f44a751 None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:37:55.137896 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:37:55.151859 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 159/319] 10.222.0.93 () {58 vars in 1023 bytes} [Tue Jul 26 14:37:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 14:37:55.166902 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995d7698-0f6e-4871-8eaa-09e1083f3460 None None] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:37:55.172921 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d045a1-e0c7-4ec4-a934-97c4874bd206 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:37:55.175152 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d045a1-e0c7-4ec4-a934-97c4874bd206 None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:55.175674 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d045a1-e0c7-4ec4-a934-97c4874bd206 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:55.176169 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d045a1-e0c7-4ec4-a934-97c4874bd206 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:55.275089 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d045a1-e0c7-4ec4-a934-97c4874bd206 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:37:55.276592 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d045a1-e0c7-4ec4-a934-97c4874bd206 None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:37:55.314510 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995d7698-0f6e-4871-8eaa-09e1083f3460 None None] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:37:55.354756 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b6b963-3864-4223-9aae-1229c024f136 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:37:55.355413 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b6b963-3864-4223-9aae-1229c024f136 None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:55.355696 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b6b963-3864-4223-9aae-1229c024f136 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:55.355971 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b6b963-3864-4223-9aae-1229c024f136 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:55.357268 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b6b963-3864-4223-9aae-1229c024f136 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:37:55.358768 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b6b963-3864-4223-9aae-1229c024f136 None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:37:55.362329 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 160/320] 10.222.0.93 () {56 vars in 1108 bytes} [Tue Jul 26 14:37:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:37:55.362329 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b6b963-3864-4223-9aae-1229c024f136 None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:37:55.419861 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:37:55.442349 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 161/321] 10.222.0.93 () {58 vars in 1282 bytes} [Tue Jul 26 14:37:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 523 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 26 14:37:55.442349 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d045a1-e0c7-4ec4-a934-97c4874bd206 None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:37:55.473621 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:37:55.516224 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b6b963-3864-4223-9aae-1229c024f136 None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:37:55.562265 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d045a1-e0c7-4ec4-a934-97c4874bd206 None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:37:55.579192 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900ed45c-7b60-4d0a-87ed-1a015aa8272c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:37:55.580327 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900ed45c-7b60-4d0a-87ed-1a015aa8272c None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:55.580826 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900ed45c-7b60-4d0a-87ed-1a015aa8272c None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:55.581895 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900ed45c-7b60-4d0a-87ed-1a015aa8272c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:55.599118 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e21d298-c520-4639-a8f5-dd62b059c719 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:37:55.599760 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e21d298-c520-4639-a8f5-dd62b059c719 None admin] REQUEST_METHOD: `POST` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:55.600048 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e21d298-c520-4639-a8f5-dd62b059c719 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:55.600322 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e21d298-c520-4639-a8f5-dd62b059c719 None admin] PATH_INFO: `/v3/groups` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:55.601077 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e21d298-c520-4639-a8f5-dd62b059c719 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:37:55.602918 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900ed45c-7b60-4d0a-87ed-1a015aa8272c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 14:37:55.603181 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e21d298-c520-4639-a8f5-dd62b059c719 None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:37:55.613542 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application [None req-900ed45c-7b60-4d0a-87ed-1a015aa8272c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 26 14:37:55.613542 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:37:55.613542 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:37:55.613542 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:37:55.613542 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:37:55.613542 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:37:55.613542 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:37:55.613542 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:37:55.613542 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:37:55.613542 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:37:55.613542 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:37:55.613542 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:37:55.613542 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 14:37:55.613542 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 14:37:55.613542 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 14:37:55.613542 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 14:37:55.615044 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 14:37:55.615044 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 14:37:55.615044 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 14:37:55.615044 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 14:37:55.615044 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:37:55.615044 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:37:55.615044 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:37:55.615044 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:37:55.615044 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:37:55.615044 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:37:55.615044 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:37:55.615044 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application with Lock( Jul 26 14:37:55.615044 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:37:55.615044 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:37:55.615044 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:37:55.615044 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:37:55.615902 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:37:55.615902 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:37:55.615902 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:37:55.615902 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:37:55.615902 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 14:37:55.615902 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 14:37:55.615902 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 14:37:55.615902 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 14:37:55.615902 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 14:37:55.615902 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 14:37:55.615902 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 26 14:37:55.615902 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Jul 26 14:37:55.616920 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 161/322] 10.222.0.93 () {56 vars in 1099 bytes} [Tue Jul 26 14:37:55 2022] GET /identity/v3/roles/reader => generated 84 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:37:55.618886 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900ed45c-7b60-4d0a-87ed-1a015aa8272c None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:37:55.772819 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:37:55.780860 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900ed45c-7b60-4d0a-87ed-1a015aa8272c None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:37:55.815116 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 162/323] 10.222.0.93 () {60 vars in 1134 bytes} [Tue Jul 26 14:37:55 2022] POST /identity/v3/groups => generated 226 bytes in 377 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 14:37:55.822573 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4830dbe6-f581-4582-a303-54d281ecf683 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:37:55.824302 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4830dbe6-f581-4582-a303-54d281ecf683 None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:55.824302 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4830dbe6-f581-4582-a303-54d281ecf683 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:55.824302 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4830dbe6-f581-4582-a303-54d281ecf683 None admin] PATH_INFO: `/v3/projects/223cfb51fde24882a520cb183c0f36f8` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:55.824604 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e21d298-c520-4639-a8f5-dd62b059c719 None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:37:55.825741 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4830dbe6-f581-4582-a303-54d281ecf683 None admin] RBAC: Authorizing `identity:get_project(project_id=223cfb51fde24882a520cb183c0f36f8)` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:37:55.827277 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4830dbe6-f581-4582-a303-54d281ecf683 None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:37:55.829396 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 162/324] 10.222.0.93 () {56 vars in 1186 bytes} [Tue Jul 26 14:37:55 2022] GET /identity/v3/projects/223cfb51fde24882a520cb183c0f36f8 => generated 302 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:37:55.837567 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4830dbe6-f581-4582-a303-54d281ecf683 None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:37:55.998201 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4830dbe6-f581-4582-a303-54d281ecf683 None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:37:56.001412 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:37:56.033159 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e21d298-c520-4639-a8f5-dd62b059c719 None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:37:56.046771 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bc254d-ae27-4d11-8cd0-bfff787f5038 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:37:56.047733 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bc254d-ae27-4d11-8cd0-bfff787f5038 None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:56.048068 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bc254d-ae27-4d11-8cd0-bfff787f5038 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:56.049275 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bc254d-ae27-4d11-8cd0-bfff787f5038 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:56.050229 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bc254d-ae27-4d11-8cd0-bfff787f5038 None admin] RBAC: Adding query filter params (role.id=8b206d8d963645f6bd492384b6c5d39f, scope.project.id=223cfb51fde24882a520cb183c0f36f8, user.id=885a2a4652614d04a7c831bab4159c0e) {{(pid=87055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:37:56.050638 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bc254d-ae27-4d11-8cd0-bfff787f5038 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:37:56.052218 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bc254d-ae27-4d11-8cd0-bfff787f5038 None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:37:56.060501 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 163/325] 10.222.0.93 () {56 vars in 1374 bytes} [Tue Jul 26 14:37:55 2022] GET /identity/v3/role_assignments?user.id=885a2a4652614d04a7c831bab4159c0e&scope.project.id=223cfb51fde24882a520cb183c0f36f8&role.id=8b206d8d963645f6bd492384b6c5d39f => generated 608 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:37:56.104641 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c416ca72-ac49-4087-91eb-daeff8475c00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:37:56.105304 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c416ca72-ac49-4087-91eb-daeff8475c00 None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:56.105589 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c416ca72-ac49-4087-91eb-daeff8475c00 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:56.105869 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c416ca72-ac49-4087-91eb-daeff8475c00 None admin] PATH_INFO: `/v3/roles` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:56.106685 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c416ca72-ac49-4087-91eb-daeff8475c00 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:37:56.107004 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c416ca72-ac49-4087-91eb-daeff8475c00 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:37:56.108468 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c416ca72-ac49-4087-91eb-daeff8475c00 None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:37:56.120104 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 163/326] 10.222.0.93 () {56 vars in 1101 bytes} [Tue Jul 26 14:37:55 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:37:56.130512 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bc254d-ae27-4d11-8cd0-bfff787f5038 None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:37:56.190194 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:37:56.318079 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bc254d-ae27-4d11-8cd0-bfff787f5038 None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:37:56.335132 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a19072-66f2-48a8-8c1f-53c3a08d29d0 None None] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:56.335902 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a19072-66f2-48a8-8c1f-53c3a08d29d0 None None] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:56.335902 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a19072-66f2-48a8-8c1f-53c3a08d29d0 None None] PATH_INFO: `/` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:56.337936 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 164/327] 10.222.0.93 () {54 vars in 926 bytes} [Tue Jul 26 14:37:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 14:37:56.347988 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db18f34-aca7-4800-a172-dbca7c013473 None None] REQUEST_METHOD: `POST` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:56.347988 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db18f34-aca7-4800-a172-dbca7c013473 None None] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:56.347988 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db18f34-aca7-4800-a172-dbca7c013473 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:56.385580 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.auth.core [None req-8db18f34-aca7-4800-a172-dbca7c013473 None None] MFA Rules not processed for user `e5ef88cc058f425b882bcb87a1e1e75c`. Rule list: `[]` (Enabled: `True`). {{(pid=87056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:37:56.388270 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.fernet_utils [None req-8db18f34-aca7-4800-a172-dbca7c013473 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:37:56.405035 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45e21e5-3adc-465a-9618-0b0d94b8680b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:37:56.406040 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45e21e5-3adc-465a-9618-0b0d94b8680b None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:56.406581 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45e21e5-3adc-465a-9618-0b0d94b8680b None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:56.408221 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45e21e5-3adc-465a-9618-0b0d94b8680b None admin] PATH_INFO: `/v3/users/34168efdd8ae4c8091a99077ad07c30b` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:56.410729 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45e21e5-3adc-465a-9618-0b0d94b8680b None admin] RBAC: Authorizing `identity:get_user(user_id=34168efdd8ae4c8091a99077ad07c30b)` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:37:56.415094 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45e21e5-3adc-465a-9618-0b0d94b8680b None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:37:56.419997 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 164/328] 10.222.0.93 () {56 vars in 1177 bytes} [Tue Jul 26 14:37:56 2022] GET /identity/v3/users/34168efdd8ae4c8091a99077ad07c30b => generated 293 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:37:56.426730 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45e21e5-3adc-465a-9618-0b0d94b8680b None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:37:56.530783 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 165/329] 10.222.0.93 () {58 vars in 1023 bytes} [Tue Jul 26 14:37:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 14:37:56.555927 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db18f34-aca7-4800-a172-dbca7c013473 None None] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:37:56.605370 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:37:56.618821 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45e21e5-3adc-465a-9618-0b0d94b8680b None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:37:56.674708 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:37:56.679555 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db18f34-aca7-4800-a172-dbca7c013473 None None] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:37:56.686559 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442523bc-d87c-406a-8241-5777822d5894 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:37:56.689827 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442523bc-d87c-406a-8241-5777822d5894 None admin] REQUEST_METHOD: `PUT` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:56.689827 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442523bc-d87c-406a-8241-5777822d5894 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:56.689827 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442523bc-d87c-406a-8241-5777822d5894 None admin] PATH_INFO: `/v3/system/users/34168efdd8ae4c8091a99077ad07c30b/roles/8b206d8d963645f6bd492384b6c5d39f` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:56.691717 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442523bc-d87c-406a-8241-5777822d5894 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=34168efdd8ae4c8091a99077ad07c30b, role_id=8b206d8d963645f6bd492384b6c5d39f)` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:37:56.696616 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442523bc-d87c-406a-8241-5777822d5894 None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:37:56.721040 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b6032e-f93a-4e41-9b54-b681c6f669f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:37:56.721711 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b6032e-f93a-4e41-9b54-b681c6f669f6 None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:56.722096 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b6032e-f93a-4e41-9b54-b681c6f669f6 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:56.722531 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b6032e-f93a-4e41-9b54-b681c6f669f6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:56.737255 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b6032e-f93a-4e41-9b54-b681c6f669f6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 14:37:56.743339 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application [None req-88b6032e-f93a-4e41-9b54-b681c6f669f6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 26 14:37:56.743339 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:37:56.743339 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:37:56.743339 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:37:56.743339 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:37:56.743339 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:37:56.743339 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:37:56.743339 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:37:56.743339 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:37:56.743339 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:37:56.743339 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:37:56.743339 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:37:56.743339 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 14:37:56.743339 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 14:37:56.743339 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 14:37:56.743339 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 14:37:56.744294 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 14:37:56.744294 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 14:37:56.744294 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 14:37:56.744294 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 14:37:56.744294 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:37:56.744294 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:37:56.744294 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:37:56.744294 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:37:56.744294 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:37:56.744294 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:37:56.744294 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:37:56.744294 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application with Lock( Jul 26 14:37:56.744294 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:37:56.744294 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:37:56.744294 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:37:56.744294 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:37:56.745093 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:37:56.745093 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:37:56.745093 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:37:56.745093 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:37:56.745093 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 14:37:56.745093 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 14:37:56.745093 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 14:37:56.745093 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 14:37:56.745093 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 14:37:56.745093 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 14:37:56.745093 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 26 14:37:56.745093 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Jul 26 14:37:56.746421 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 166/330] 10.222.0.93 () {56 vars in 1099 bytes} [Tue Jul 26 14:37:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:37:56.751393 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b6032e-f93a-4e41-9b54-b681c6f669f6 None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:37:56.805849 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 165/331] 10.222.0.93 () {58 vars in 1334 bytes} [Tue Jul 26 14:37:56 2022] PUT /identity/v3/system/users/34168efdd8ae4c8091a99077ad07c30b/roles/8b206d8d963645f6bd492384b6c5d39f => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 14:37:56.872448 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b6032e-f93a-4e41-9b54-b681c6f669f6 None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:37:56.914081 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3140a1c1-d387-403a-9b00-bd3a3d2e3c90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:37:56.915263 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3140a1c1-d387-403a-9b00-bd3a3d2e3c90 None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:56.915590 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3140a1c1-d387-403a-9b00-bd3a3d2e3c90 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:56.915825 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3140a1c1-d387-403a-9b00-bd3a3d2e3c90 None admin] PATH_INFO: `/v3/roles` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:56.916559 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3140a1c1-d387-403a-9b00-bd3a3d2e3c90 None admin] RBAC: Adding query filter params (name=member) {{(pid=87056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:37:56.916867 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3140a1c1-d387-403a-9b00-bd3a3d2e3c90 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:37:56.918356 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3140a1c1-d387-403a-9b00-bd3a3d2e3c90 None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:37:56.920052 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:37:56.928844 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 167/332] 10.222.0.93 () {56 vars in 1101 bytes} [Tue Jul 26 14:37:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:37:56.939503 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442523bc-d87c-406a-8241-5777822d5894 None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:37:57.174299 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442523bc-d87c-406a-8241-5777822d5894 None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:37:57.221231 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b00183-9eff-4633-b5ed-27ab45e2ec09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:37:57.221901 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b00183-9eff-4633-b5ed-27ab45e2ec09 None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:57.222184 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b00183-9eff-4633-b5ed-27ab45e2ec09 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:57.222489 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b00183-9eff-4633-b5ed-27ab45e2ec09 None admin] PATH_INFO: `/v3/users/a92c7220a8c84950b63d6fa4ccd4a549` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:57.223734 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b00183-9eff-4633-b5ed-27ab45e2ec09 None admin] RBAC: Authorizing `identity:get_user(user_id=a92c7220a8c84950b63d6fa4ccd4a549)` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:37:57.225360 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b00183-9eff-4633-b5ed-27ab45e2ec09 None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:37:57.228481 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 166/333] 10.222.0.93 () {56 vars in 1177 bytes} [Tue Jul 26 14:37:56 2022] GET /identity/v3/users/a92c7220a8c84950b63d6fa4ccd4a549 => generated 293 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:37:57.234610 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3140a1c1-d387-403a-9b00-bd3a3d2e3c90 None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:37:57.390643 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3140a1c1-d387-403a-9b00-bd3a3d2e3c90 None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:37:57.441041 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8011a84e-398b-4718-99e4-db27e7dc2a2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:37:57.441620 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8011a84e-398b-4718-99e4-db27e7dc2a2d None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:57.441901 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8011a84e-398b-4718-99e4-db27e7dc2a2d None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:57.442182 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8011a84e-398b-4718-99e4-db27e7dc2a2d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:57.443032 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8011a84e-398b-4718-99e4-db27e7dc2a2d None admin] RBAC: Adding query filter params (role.id=8b8a4a451dc84c17bba824b2ff9cc4fe, user.id=a92c7220a8c84950b63d6fa4ccd4a549, scope.system=all) {{(pid=87056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:37:57.443348 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8011a84e-398b-4718-99e4-db27e7dc2a2d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:37:57.444830 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8011a84e-398b-4718-99e4-db27e7dc2a2d None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:37:57.461683 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 168/334] 10.222.0.93 () {56 vars in 1308 bytes} [Tue Jul 26 14:37:57 2022] GET /identity/v3/role_assignments?user.id=a92c7220a8c84950b63d6fa4ccd4a549&scope.system=all&role.id=8b8a4a451dc84c17bba824b2ff9cc4fe => generated 510 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:37:59.255126 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5c1310-48c0-4a2f-80df-1512c1d98103 None None] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:59.256021 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5c1310-48c0-4a2f-80df-1512c1d98103 None None] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:59.256310 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5c1310-48c0-4a2f-80df-1512c1d98103 None None] PATH_INFO: `/` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:59.258669 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 167/335] 10.222.0.93 () {54 vars in 926 bytes} [Tue Jul 26 14:37:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:37:59.264703 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6126a1-e3f6-4a03-9a57-09259bdbb0d4 None None] REQUEST_METHOD: `POST` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:59.265399 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6126a1-e3f6-4a03-9a57-09259bdbb0d4 None None] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:59.265399 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6126a1-e3f6-4a03-9a57-09259bdbb0d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:59.298916 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.auth.core [None req-1b6126a1-e3f6-4a03-9a57-09259bdbb0d4 None None] MFA Rules not processed for user `e5ef88cc058f425b882bcb87a1e1e75c`. Rule list: `[]` (Enabled: `True`). {{(pid=87056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:37:59.300143 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.fernet_utils [None req-1b6126a1-e3f6-4a03-9a57-09259bdbb0d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:37:59.359797 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:37:59.382518 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 169/336] 10.222.0.93 () {58 vars in 1023 bytes} [Tue Jul 26 14:37:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 14:37:59.418596 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5c1310-48c0-4a2f-80df-1512c1d98103 None None] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:37:59.468838 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:37:59.593667 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5c1310-48c0-4a2f-80df-1512c1d98103 None None] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:37:59.639430 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b2d96e-f09f-418b-9701-31247ba3fd96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:37:59.640084 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b2d96e-f09f-418b-9701-31247ba3fd96 None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:59.640362 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b2d96e-f09f-418b-9701-31247ba3fd96 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:59.640631 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b2d96e-f09f-418b-9701-31247ba3fd96 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:59.658802 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b2d96e-f09f-418b-9701-31247ba3fd96 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 14:37:59.665218 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a790db4-0f7a-48db-be14-5701ae8efe17 None None] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:59.665516 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a790db4-0f7a-48db-be14-5701ae8efe17 None None] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:59.665766 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a790db4-0f7a-48db-be14-5701ae8efe17 None None] PATH_INFO: `/` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:59.665980 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application [None req-c8b2d96e-f09f-418b-9701-31247ba3fd96 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 14:37:59.665980 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:37:59.665980 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:37:59.665980 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:37:59.665980 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:37:59.665980 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:37:59.665980 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:37:59.665980 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:37:59.665980 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:37:59.665980 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:37:59.665980 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:37:59.665980 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:37:59.665980 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 14:37:59.665980 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 14:37:59.665980 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 14:37:59.665980 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 14:37:59.666837 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 14:37:59.666837 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 14:37:59.666837 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 14:37:59.666837 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 14:37:59.666837 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:37:59.666837 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:37:59.666837 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:37:59.666837 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:37:59.666837 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:37:59.666837 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:37:59.666837 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:37:59.666837 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application with Lock( Jul 26 14:37:59.666837 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:37:59.666837 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:37:59.666837 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:37:59.666837 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:37:59.667603 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:37:59.667603 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:37:59.667603 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:37:59.667603 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:37:59.667603 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 14:37:59.667603 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 14:37:59.667603 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 14:37:59.667603 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 14:37:59.667603 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 14:37:59.667603 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 14:37:59.667603 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 14:37:59.667603 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Jul 26 14:37:59.668186 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 170/337] 10.222.0.93 () {54 vars in 926 bytes} [Tue Jul 26 14:37:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:37:59.668284 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 168/338] 10.222.0.93 () {56 vars in 1114 bytes} [Tue Jul 26 14:37:59 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:37:59.676790 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a790db4-0f7a-48db-be14-5701ae8efe17 None None] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:37:59.682053 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d958a32-9d87-435a-8e47-42b80aadccfa None None] REQUEST_METHOD: `POST` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:59.682576 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d958a32-9d87-435a-8e47-42b80aadccfa None None] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:59.682976 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d958a32-9d87-435a-8e47-42b80aadccfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:59.723281 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.auth.core [None req-3d958a32-9d87-435a-8e47-42b80aadccfa None None] MFA Rules not processed for user `e5ef88cc058f425b882bcb87a1e1e75c`. Rule list: `[]` (Enabled: `True`). {{(pid=87055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:37:59.726137 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.fernet_utils [None req-3d958a32-9d87-435a-8e47-42b80aadccfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:37:59.866040 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 169/339] 10.222.0.93 () {58 vars in 1023 bytes} [Tue Jul 26 14:37:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 14:37:59.908242 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a790db4-0f7a-48db-be14-5701ae8efe17 None None] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:37:59.955716 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d958a32-9d87-435a-8e47-42b80aadccfa None None] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:37:59.982188 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d61b634-0553-422e-8a78-a97b2ce68d16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:37:59.983807 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d61b634-0553-422e-8a78-a97b2ce68d16 None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:37:59.984096 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d61b634-0553-422e-8a78-a97b2ce68d16 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:37:59.984592 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d61b634-0553-422e-8a78-a97b2ce68d16 None admin] PATH_INFO: `/v3/roles` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:37:59.985338 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d61b634-0553-422e-8a78-a97b2ce68d16 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:37:59.985649 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d61b634-0553-422e-8a78-a97b2ce68d16 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:37:59.987564 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d61b634-0553-422e-8a78-a97b2ce68d16 None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:37:59.997127 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:38:00.001847 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 171/340] 10.222.0.93 () {56 vars in 1111 bytes} [Tue Jul 26 14:37:59 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:38:00.011579 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d61b634-0553-422e-8a78-a97b2ce68d16 None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:00.113198 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:38:00.200740 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d958a32-9d87-435a-8e47-42b80aadccfa None None] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:00.269889 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003188e2-0fde-4b13-8860-4b844b0e5cbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:00.271404 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003188e2-0fde-4b13-8860-4b844b0e5cbe None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:00.271907 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003188e2-0fde-4b13-8860-4b844b0e5cbe None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:00.272412 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003188e2-0fde-4b13-8860-4b844b0e5cbe None admin] PATH_INFO: `/v3/roles/member` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:00.276815 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d61b634-0553-422e-8a78-a97b2ce68d16 None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:00.303456 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003188e2-0fde-4b13-8860-4b844b0e5cbe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 14:38:00.309315 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application [None req-003188e2-0fde-4b13-8860-4b844b0e5cbe None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 26 14:38:00.309315 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:38:00.309315 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:38:00.309315 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:38:00.309315 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:38:00.309315 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:38:00.309315 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:38:00.309315 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:38:00.309315 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:38:00.309315 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:38:00.309315 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:38:00.309315 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:38:00.309315 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 14:38:00.309315 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 14:38:00.309315 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 14:38:00.309315 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 14:38:00.310286 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 14:38:00.310286 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 14:38:00.310286 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 14:38:00.310286 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 14:38:00.310286 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:38:00.310286 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:38:00.310286 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:38:00.310286 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:38:00.310286 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:38:00.310286 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:38:00.310286 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:38:00.310286 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application with Lock( Jul 26 14:38:00.310286 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:38:00.310286 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:38:00.310286 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:38:00.310286 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:38:00.311245 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:38:00.311245 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:38:00.311245 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:38:00.311245 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:38:00.311245 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 14:38:00.311245 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 14:38:00.311245 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 14:38:00.311245 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 14:38:00.311245 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 14:38:00.311245 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 14:38:00.311245 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 26 14:38:00.311245 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Jul 26 14:38:00.313765 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 170/341] 10.222.0.93 () {56 vars in 1099 bytes} [Tue Jul 26 14:37:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 359 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:38:00.322462 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003188e2-0fde-4b13-8860-4b844b0e5cbe None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:00.366236 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a45c54e-4342-4f17-af81-fc2840f87dd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:00.367036 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a45c54e-4342-4f17-af81-fc2840f87dd5 None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:00.367330 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a45c54e-4342-4f17-af81-fc2840f87dd5 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:00.368471 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a45c54e-4342-4f17-af81-fc2840f87dd5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:00.568644 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a45c54e-4342-4f17-af81-fc2840f87dd5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:38:00.570104 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a45c54e-4342-4f17-af81-fc2840f87dd5 None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:38:00.572624 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:38:00.607392 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003188e2-0fde-4b13-8860-4b844b0e5cbe None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:00.644301 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:38:00.663223 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05fca41-885e-46a8-9170-8aec8aed11c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:00.665407 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05fca41-885e-46a8-9170-8aec8aed11c6 None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:00.666217 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05fca41-885e-46a8-9170-8aec8aed11c6 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:00.667037 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05fca41-885e-46a8-9170-8aec8aed11c6 None admin] PATH_INFO: `/v3/roles` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:00.668121 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05fca41-885e-46a8-9170-8aec8aed11c6 None admin] RBAC: Adding query filter params (name=member) {{(pid=87055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:38:00.668854 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05fca41-885e-46a8-9170-8aec8aed11c6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:38:00.672729 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05fca41-885e-46a8-9170-8aec8aed11c6 None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:38:00.687110 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 171/342] 10.222.0.93 () {56 vars in 1101 bytes} [Tue Jul 26 14:38:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 366 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:38:00.688797 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92707c8-4835-4b28-8fe6-1a0d5d9715e8 None None] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:00.689404 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92707c8-4835-4b28-8fe6-1a0d5d9715e8 None None] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:00.689884 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92707c8-4835-4b28-8fe6-1a0d5d9715e8 None None] PATH_INFO: `/` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:00.694268 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 172/343] 10.222.0.93 () {54 vars in 926 bytes} [Tue Jul 26 14:38:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:38:00.697237 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92707c8-4835-4b28-8fe6-1a0d5d9715e8 None None] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:00.736041 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 172/344] 10.222.0.93 () {58 vars in 1282 bytes} [Tue Jul 26 14:38:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 725 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 26 14:38:00.738108 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b2a82a-823a-4eff-b262-d68bd7cbe0e4 None None] REQUEST_METHOD: `POST` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:00.738421 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b2a82a-823a-4eff-b262-d68bd7cbe0e4 None None] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:00.738828 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b2a82a-823a-4eff-b262-d68bd7cbe0e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:00.780330 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.auth.core [None req-f0b2a82a-823a-4eff-b262-d68bd7cbe0e4 None None] MFA Rules not processed for user `e5ef88cc058f425b882bcb87a1e1e75c`. Rule list: `[]` (Enabled: `True`). {{(pid=87056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:38:00.781577 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.fernet_utils [None req-f0b2a82a-823a-4eff-b262-d68bd7cbe0e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:38:00.893220 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92707c8-4835-4b28-8fe6-1a0d5d9715e8 None None] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:00.901528 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 173/345] 10.222.0.93 () {58 vars in 1023 bytes} [Tue Jul 26 14:38:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 14:38:00.903037 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2db7405-ce8e-40ad-beae-38c5543884f5 None None] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:00.903353 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2db7405-ce8e-40ad-beae-38c5543884f5 None None] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:00.903609 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2db7405-ce8e-40ad-beae-38c5543884f5 None None] PATH_INFO: `/` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:00.910441 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 174/346] 10.222.0.93 () {54 vars in 926 bytes} [Tue Jul 26 14:38:00 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:38:00.911451 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2db7405-ce8e-40ad-beae-38c5543884f5 None None] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:00.966039 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c36803-7152-4200-8d6e-1ab5529ca0ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:00.966720 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c36803-7152-4200-8d6e-1ab5529ca0ec None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:00.967005 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c36803-7152-4200-8d6e-1ab5529ca0ec None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:00.967289 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c36803-7152-4200-8d6e-1ab5529ca0ec None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:00.983160 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:38:01.052769 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:38:01.086578 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c36803-7152-4200-8d6e-1ab5529ca0ec None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:38:01.088412 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c36803-7152-4200-8d6e-1ab5529ca0ec None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:38:01.104247 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2db7405-ce8e-40ad-beae-38c5543884f5 None None] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:01.160456 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0e4a41-1099-4068-bfc3-5455f5c3f6ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:01.161051 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0e4a41-1099-4068-bfc3-5455f5c3f6ed None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:01.161336 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0e4a41-1099-4068-bfc3-5455f5c3f6ed None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:01.161618 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0e4a41-1099-4068-bfc3-5455f5c3f6ed None admin] PATH_INFO: `/v3/projects/798795388b0c46a3a4ae48ca79f5c6ce` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:01.162901 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0e4a41-1099-4068-bfc3-5455f5c3f6ed None admin] RBAC: Authorizing `identity:get_project(project_id=798795388b0c46a3a4ae48ca79f5c6ce)` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:38:01.164632 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0e4a41-1099-4068-bfc3-5455f5c3f6ed None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:38:01.166389 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 175/347] 10.222.0.93 () {56 vars in 1186 bytes} [Tue Jul 26 14:38:00 2022] GET /identity/v3/projects/798795388b0c46a3a4ae48ca79f5c6ce => generated 298 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:38:01.167605 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f7ca75-84f4-46ff-a7eb-2dc86646f36e None None] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:01.167890 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f7ca75-84f4-46ff-a7eb-2dc86646f36e None None] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:01.168166 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f7ca75-84f4-46ff-a7eb-2dc86646f36e None None] PATH_INFO: `/` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:01.169657 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 176/348] 10.222.0.93 () {54 vars in 926 bytes} [Tue Jul 26 14:38:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:38:01.170769 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268ba105-82c5-4c8a-a6d2-ef6722fe4fc7 None None] REQUEST_METHOD: `POST` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:01.171206 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268ba105-82c5-4c8a-a6d2-ef6722fe4fc7 None None] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:01.171491 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268ba105-82c5-4c8a-a6d2-ef6722fe4fc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:01.198041 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.auth.core [None req-268ba105-82c5-4c8a-a6d2-ef6722fe4fc7 None None] MFA Rules not processed for user `e5ef88cc058f425b882bcb87a1e1e75c`. Rule list: `[]` (Enabled: `True`). {{(pid=87056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:38:01.200257 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.fernet_utils [None req-268ba105-82c5-4c8a-a6d2-ef6722fe4fc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:38:01.245181 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 173/349] 10.222.0.93 () {58 vars in 1282 bytes} [Tue Jul 26 14:38:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 550 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 14:38:01.246017 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c36803-7152-4200-8d6e-1ab5529ca0ec None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:01.324349 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:38:01.325846 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 177/350] 10.222.0.93 () {58 vars in 1023 bytes} [Tue Jul 26 14:38:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 14:38:01.327613 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61776031-a969-46ab-a0a4-5860b0e914bd None None] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:01.328072 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61776031-a969-46ab-a0a4-5860b0e914bd None None] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:01.328420 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61776031-a969-46ab-a0a4-5860b0e914bd None None] PATH_INFO: `/` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:01.331178 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 178/351] 10.222.0.93 () {54 vars in 926 bytes} [Tue Jul 26 14:38:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:38:01.331604 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61776031-a969-46ab-a0a4-5860b0e914bd None None] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:01.427350 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c36803-7152-4200-8d6e-1ab5529ca0ec None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:01.459480 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:38:01.481565 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215c385d-0220-4fda-9cbc-2ff04f3cd914 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:01.483000 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215c385d-0220-4fda-9cbc-2ff04f3cd914 None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:01.483504 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215c385d-0220-4fda-9cbc-2ff04f3cd914 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:01.484006 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215c385d-0220-4fda-9cbc-2ff04f3cd914 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:01.498806 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61776031-a969-46ab-a0a4-5860b0e914bd None None] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:01.501742 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215c385d-0220-4fda-9cbc-2ff04f3cd914 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 14:38:01.513746 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application [None req-215c385d-0220-4fda-9cbc-2ff04f3cd914 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 26 14:38:01.513746 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:38:01.513746 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:38:01.513746 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:38:01.513746 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:38:01.513746 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:38:01.513746 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:38:01.513746 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:38:01.513746 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:38:01.513746 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:38:01.513746 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:38:01.513746 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:38:01.513746 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 14:38:01.513746 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 14:38:01.513746 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 14:38:01.513746 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 14:38:01.515292 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 14:38:01.515292 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 14:38:01.515292 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 14:38:01.515292 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 14:38:01.515292 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:38:01.515292 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:38:01.515292 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:38:01.515292 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:38:01.515292 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:38:01.515292 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:38:01.515292 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:38:01.515292 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application with Lock( Jul 26 14:38:01.515292 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:38:01.515292 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:38:01.515292 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:38:01.515292 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:38:01.516507 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:38:01.516507 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:38:01.516507 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:38:01.516507 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:38:01.516507 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 14:38:01.516507 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 14:38:01.516507 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 14:38:01.516507 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 14:38:01.516507 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 14:38:01.516507 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 14:38:01.516507 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 26 14:38:01.516507 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Jul 26 14:38:01.516507 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 174/352] 10.222.0.93 () {56 vars in 1099 bytes} [Tue Jul 26 14:38:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:38:01.517501 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b677e4c-7108-4e97-b2cb-9d26ba8c5b5c None None] REQUEST_METHOD: `POST` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:01.517642 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b677e4c-7108-4e97-b2cb-9d26ba8c5b5c None None] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:01.518299 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b677e4c-7108-4e97-b2cb-9d26ba8c5b5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:01.542450 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.auth.core [None req-9b677e4c-7108-4e97-b2cb-9d26ba8c5b5c None None] MFA Rules not processed for user `e5ef88cc058f425b882bcb87a1e1e75c`. Rule list: `[]` (Enabled: `True`). {{(pid=87055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:38:01.543876 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.fernet_utils [None req-9b677e4c-7108-4e97-b2cb-9d26ba8c5b5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:38:01.560672 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f2aa4f-bb64-4272-904c-393378f5bba6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:01.561359 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f2aa4f-bb64-4272-904c-393378f5bba6 None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:01.561702 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f2aa4f-bb64-4272-904c-393378f5bba6 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:01.562163 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f2aa4f-bb64-4272-904c-393378f5bba6 None admin] PATH_INFO: `/v3/groups/2c517fc77ff14f6680fe39decfb3c543` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:01.572861 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f2aa4f-bb64-4272-904c-393378f5bba6 None admin] RBAC: Authorizing `identity:get_group(group_id=2c517fc77ff14f6680fe39decfb3c543)` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:38:01.574400 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f2aa4f-bb64-4272-904c-393378f5bba6 None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:38:01.576342 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 179/353] 10.222.0.93 () {56 vars in 1180 bytes} [Tue Jul 26 14:38:01 2022] GET /identity/v3/groups/2c517fc77ff14f6680fe39decfb3c543 => generated 226 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:38:01.577090 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f2aa4f-bb64-4272-904c-393378f5bba6 None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:01.655068 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 175/354] 10.222.0.93 () {58 vars in 1023 bytes} [Tue Jul 26 14:38:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 14:38:01.658292 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2963adff-48e1-480a-8c46-52ccb4c47a75 None None] REQUEST_METHOD: `POST` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:01.662903 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2963adff-48e1-480a-8c46-52ccb4c47a75 None None] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:01.663257 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2963adff-48e1-480a-8c46-52ccb4c47a75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:01.685010 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.auth.core [None req-2963adff-48e1-480a-8c46-52ccb4c47a75 None None] MFA Rules not processed for user `e5ef88cc058f425b882bcb87a1e1e75c`. Rule list: `[]` (Enabled: `True`). {{(pid=87055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:38:01.686175 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.fernet_utils [None req-2963adff-48e1-480a-8c46-52ccb4c47a75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:38:01.732088 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:38:01.737324 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f2aa4f-bb64-4272-904c-393378f5bba6 None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:01.789221 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baaab4bc-84ff-4e53-9ee0-a90e544f0906 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:01.790323 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaab4bc-84ff-4e53-9ee0-a90e544f0906 None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:01.790794 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaab4bc-84ff-4e53-9ee0-a90e544f0906 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:01.791217 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaab4bc-84ff-4e53-9ee0-a90e544f0906 None admin] PATH_INFO: `/v3/projects/798795388b0c46a3a4ae48ca79f5c6ce` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:01.792530 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 176/355] 10.222.0.93 () {58 vars in 1023 bytes} [Tue Jul 26 14:38:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 14:38:01.793109 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baaab4bc-84ff-4e53-9ee0-a90e544f0906 None admin] RBAC: Authorizing `identity:get_project(project_id=798795388b0c46a3a4ae48ca79f5c6ce)` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:38:01.794114 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2963adff-48e1-480a-8c46-52ccb4c47a75 None None] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:01.795187 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baaab4bc-84ff-4e53-9ee0-a90e544f0906 None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:38:01.797234 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 180/356] 10.222.0.93 () {56 vars in 1186 bytes} [Tue Jul 26 14:38:01 2022] GET /identity/v3/projects/798795388b0c46a3a4ae48ca79f5c6ce => generated 298 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:38:01.797859 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baaab4bc-84ff-4e53-9ee0-a90e544f0906 None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:01.808096 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:38:01.931141 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baaab4bc-84ff-4e53-9ee0-a90e544f0906 None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:01.964234 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2963adff-48e1-480a-8c46-52ccb4c47a75 None None] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:01.997339 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427e0677-cf05-4643-8fb4-479c073534e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:01.998440 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427e0677-cf05-4643-8fb4-479c073534e4 None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:01.998904 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427e0677-cf05-4643-8fb4-479c073534e4 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:02.001159 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427e0677-cf05-4643-8fb4-479c073534e4 None admin] PATH_INFO: `/v3/roles` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:02.001159 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427e0677-cf05-4643-8fb4-479c073534e4 None admin] RBAC: Adding query filter params (name=member) {{(pid=87056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:38:02.001159 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427e0677-cf05-4643-8fb4-479c073534e4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:38:02.003608 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427e0677-cf05-4643-8fb4-479c073534e4 None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:38:02.020950 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 181/357] 10.222.0.93 () {56 vars in 1101 bytes} [Tue Jul 26 14:38:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:38:02.021988 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427e0677-cf05-4643-8fb4-479c073534e4 None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:02.028654 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd79330-773d-4be8-ad5e-39af0341438e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:02.029353 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd79330-773d-4be8-ad5e-39af0341438e None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:02.029637 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd79330-773d-4be8-ad5e-39af0341438e None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:02.029915 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd79330-773d-4be8-ad5e-39af0341438e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:02.051233 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd79330-773d-4be8-ad5e-39af0341438e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 14:38:02.057683 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application [None req-2dd79330-773d-4be8-ad5e-39af0341438e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 26 14:38:02.057683 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:38:02.057683 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:38:02.057683 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:38:02.057683 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:38:02.057683 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:38:02.057683 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:38:02.057683 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:38:02.057683 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:38:02.057683 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:38:02.057683 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:38:02.057683 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:38:02.057683 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 14:38:02.057683 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 14:38:02.057683 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 14:38:02.057683 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 14:38:02.058730 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 14:38:02.058730 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 14:38:02.058730 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 14:38:02.058730 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 14:38:02.058730 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:38:02.058730 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:38:02.058730 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:38:02.058730 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:38:02.058730 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:38:02.058730 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:38:02.058730 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:38:02.058730 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application with Lock( Jul 26 14:38:02.058730 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:38:02.058730 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:38:02.058730 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:38:02.058730 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:38:02.059949 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:38:02.059949 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:38:02.059949 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:38:02.059949 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:38:02.059949 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 14:38:02.059949 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 14:38:02.059949 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 14:38:02.059949 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 14:38:02.059949 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 14:38:02.059949 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 14:38:02.059949 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 26 14:38:02.059949 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Jul 26 14:38:02.059949 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 177/358] 10.222.0.93 () {56 vars in 1099 bytes} [Tue Jul 26 14:38:01 2022] GET /identity/v3/roles/reader => generated 84 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:38:02.062760 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd79330-773d-4be8-ad5e-39af0341438e None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:02.089490 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:38:02.161763 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:38:02.209246 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427e0677-cf05-4643-8fb4-479c073534e4 None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:02.235173 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd79330-773d-4be8-ad5e-39af0341438e None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:02.271373 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d9160c-28b7-4001-b241-69c0c906ae61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:02.272291 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d9160c-28b7-4001-b241-69c0c906ae61 None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:02.272759 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d9160c-28b7-4001-b241-69c0c906ae61 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:02.273157 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d9160c-28b7-4001-b241-69c0c906ae61 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:02.275137 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d9160c-28b7-4001-b241-69c0c906ae61 None admin] RBAC: Adding query filter params (group.id=2c517fc77ff14f6680fe39decfb3c543, role.id=ef1a806f8d774452a6536b57a4670ceb, scope.project.id=798795388b0c46a3a4ae48ca79f5c6ce) {{(pid=87056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:38:02.275490 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d9160c-28b7-4001-b241-69c0c906ae61 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:38:02.277430 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d9160c-28b7-4001-b241-69c0c906ae61 None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:38:02.282104 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98663782-908d-496c-8b20-18a6c6cf5449 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:02.282799 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98663782-908d-496c-8b20-18a6c6cf5449 None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:02.283104 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98663782-908d-496c-8b20-18a6c6cf5449 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:02.283346 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98663782-908d-496c-8b20-18a6c6cf5449 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:02.286126 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 182/359] 10.222.0.93 () {56 vars in 1376 bytes} [Tue Jul 26 14:38:02 2022] GET /identity/v3/role_assignments?group.id=2c517fc77ff14f6680fe39decfb3c543&scope.project.id=798795388b0c46a3a4ae48ca79f5c6ce&role.id=ef1a806f8d774452a6536b57a4670ceb => generated 260 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:38:02.287320 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d9160c-28b7-4001-b241-69c0c906ae61 None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:02.301808 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98663782-908d-496c-8b20-18a6c6cf5449 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 14:38:02.308454 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application [None req-98663782-908d-496c-8b20-18a6c6cf5449 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 14:38:02.308454 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:38:02.308454 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:38:02.308454 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:38:02.308454 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:38:02.308454 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:38:02.308454 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:38:02.308454 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:38:02.308454 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:38:02.308454 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:38:02.308454 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:38:02.308454 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:38:02.308454 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 14:38:02.308454 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 14:38:02.308454 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 14:38:02.308454 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 14:38:02.311311 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 14:38:02.311311 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 14:38:02.311311 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 14:38:02.311311 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 14:38:02.311311 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:38:02.311311 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:38:02.311311 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:38:02.311311 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:38:02.311311 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:38:02.311311 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:38:02.311311 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:38:02.311311 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application with Lock( Jul 26 14:38:02.311311 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:38:02.311311 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:38:02.311311 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:38:02.311311 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:38:02.312953 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:38:02.312953 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:38:02.312953 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:38:02.312953 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:38:02.312953 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 14:38:02.312953 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 14:38:02.312953 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 14:38:02.312953 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 14:38:02.312953 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 14:38:02.312953 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 14:38:02.312953 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 14:38:02.312953 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Jul 26 14:38:02.312953 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 178/360] 10.222.0.93 () {56 vars in 1096 bytes} [Tue Jul 26 14:38:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:38:02.312953 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98663782-908d-496c-8b20-18a6c6cf5449 None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:02.449308 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:38:02.450537 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d9160c-28b7-4001-b241-69c0c906ae61 None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:02.493041 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:38:02.494111 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98663782-908d-496c-8b20-18a6c6cf5449 None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:02.505444 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100ed678-1a10-4e31-a241-82c6152576bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:02.505444 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100ed678-1a10-4e31-a241-82c6152576bd None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:02.505444 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100ed678-1a10-4e31-a241-82c6152576bd None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:02.508957 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100ed678-1a10-4e31-a241-82c6152576bd None admin] PATH_INFO: `/v3/groups/2c517fc77ff14f6680fe39decfb3c543` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:02.510974 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100ed678-1a10-4e31-a241-82c6152576bd None admin] RBAC: Authorizing `identity:get_group(group_id=2c517fc77ff14f6680fe39decfb3c543)` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:38:02.513414 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100ed678-1a10-4e31-a241-82c6152576bd None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:38:02.514535 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 183/361] 10.222.0.93 () {56 vars in 1180 bytes} [Tue Jul 26 14:38:02 2022] GET /identity/v3/groups/2c517fc77ff14f6680fe39decfb3c543 => generated 226 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:38:02.515849 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100ed678-1a10-4e31-a241-82c6152576bd None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:02.568235 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbd2a82-9b07-4af9-958b-74bc039dd4d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:02.568962 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbd2a82-9b07-4af9-958b-74bc039dd4d1 None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:02.569247 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbd2a82-9b07-4af9-958b-74bc039dd4d1 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:02.569567 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbd2a82-9b07-4af9-958b-74bc039dd4d1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:02.592399 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbd2a82-9b07-4af9-958b-74bc039dd4d1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 14:38:02.600426 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application [None req-4fbd2a82-9b07-4af9-958b-74bc039dd4d1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 14:38:02.600426 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:38:02.600426 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:38:02.600426 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:38:02.600426 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:38:02.600426 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:38:02.600426 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:38:02.600426 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:38:02.600426 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:38:02.600426 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:38:02.600426 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:38:02.600426 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:38:02.600426 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 14:38:02.600426 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 14:38:02.600426 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 14:38:02.600426 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 14:38:02.603254 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 14:38:02.603254 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 14:38:02.603254 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 14:38:02.603254 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 14:38:02.603254 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:38:02.603254 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:38:02.603254 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:38:02.603254 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:38:02.603254 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:38:02.603254 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:38:02.603254 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:38:02.603254 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application with Lock( Jul 26 14:38:02.603254 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:38:02.603254 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:38:02.603254 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:38:02.603254 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:38:02.604677 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:38:02.604677 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:38:02.604677 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:38:02.604677 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:38:02.604677 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 14:38:02.604677 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 14:38:02.604677 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 14:38:02.604677 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 14:38:02.604677 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 14:38:02.604677 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 14:38:02.604677 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 14:38:02.604677 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Jul 26 14:38:02.604677 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 179/362] 10.222.0.93 () {56 vars in 1114 bytes} [Tue Jul 26 14:38:02 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:38:02.607497 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbd2a82-9b07-4af9-958b-74bc039dd4d1 None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:02.687277 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100ed678-1a10-4e31-a241-82c6152576bd None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:02.731843 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb838f2-fa1b-4972-af23-af9e37528850 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:02.732770 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb838f2-fa1b-4972-af23-af9e37528850 None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:02.733060 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb838f2-fa1b-4972-af23-af9e37528850 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:02.733324 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb838f2-fa1b-4972-af23-af9e37528850 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:02.763191 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbd2a82-9b07-4af9-958b-74bc039dd4d1 None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:02.805290 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13c837d-f919-4ad5-8eae-8c6e352c440f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:02.806021 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13c837d-f919-4ad5-8eae-8c6e352c440f None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:02.806326 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13c837d-f919-4ad5-8eae-8c6e352c440f None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:02.806629 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13c837d-f919-4ad5-8eae-8c6e352c440f None admin] PATH_INFO: `/v3/roles` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:02.807365 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13c837d-f919-4ad5-8eae-8c6e352c440f None admin] RBAC: Adding query filter params (name=reader) {{(pid=87055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:38:02.807678 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13c837d-f919-4ad5-8eae-8c6e352c440f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:38:02.809157 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13c837d-f919-4ad5-8eae-8c6e352c440f None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:38:02.815616 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:38:02.820380 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 180/363] 10.222.0.93 () {56 vars in 1101 bytes} [Tue Jul 26 14:38:02 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:38:02.822480 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:38:02.825373 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb838f2-fa1b-4972-af23-af9e37528850 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:38:02.827592 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb838f2-fa1b-4972-af23-af9e37528850 None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:38:02.827898 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13c837d-f919-4ad5-8eae-8c6e352c440f None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:02.956525 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13c837d-f919-4ad5-8eae-8c6e352c440f None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:02.997178 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 184/364] 10.222.0.93 () {58 vars in 1282 bytes} [Tue Jul 26 14:38:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 478 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 14:38:02.997178 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb838f2-fa1b-4972-af23-af9e37528850 None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:03.019804 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bea775-b956-4d5f-8ff6-db679a55ef2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:03.020780 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bea775-b956-4d5f-8ff6-db679a55ef2b None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:03.021288 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bea775-b956-4d5f-8ff6-db679a55ef2b None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:03.021797 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bea775-b956-4d5f-8ff6-db679a55ef2b None admin] PATH_INFO: `/v3/roles` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:03.023708 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bea775-b956-4d5f-8ff6-db679a55ef2b None admin] RBAC: Adding query filter params (name=admin) {{(pid=87055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:38:03.024265 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bea775-b956-4d5f-8ff6-db679a55ef2b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:38:03.026968 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bea775-b956-4d5f-8ff6-db679a55ef2b None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:38:03.043726 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 181/365] 10.222.0.93 () {56 vars in 1099 bytes} [Tue Jul 26 14:38:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:38:03.045156 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bea775-b956-4d5f-8ff6-db679a55ef2b None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:03.146160 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:38:03.158863 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:38:03.163261 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb838f2-fa1b-4972-af23-af9e37528850 None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:03.217993 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bea775-b956-4d5f-8ff6-db679a55ef2b None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:03.223370 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a743e41-5415-4444-8edb-f8b8bf99a518 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:03.224196 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a743e41-5415-4444-8edb-f8b8bf99a518 None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:03.224610 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a743e41-5415-4444-8edb-f8b8bf99a518 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:03.225010 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a743e41-5415-4444-8edb-f8b8bf99a518 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:03.226046 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a743e41-5415-4444-8edb-f8b8bf99a518 None admin] RBAC: Adding query filter params (group.id=2c517fc77ff14f6680fe39decfb3c543, role.id=8b8a4a451dc84c17bba824b2ff9cc4fe, scope.project.id=798795388b0c46a3a4ae48ca79f5c6ce) {{(pid=87056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:38:03.226813 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a743e41-5415-4444-8edb-f8b8bf99a518 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:38:03.228265 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a743e41-5415-4444-8edb-f8b8bf99a518 None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:38:03.242282 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 185/366] 10.222.0.93 () {56 vars in 1376 bytes} [Tue Jul 26 14:38:02 2022] GET /identity/v3/role_assignments?group.id=2c517fc77ff14f6680fe39decfb3c543&scope.project.id=798795388b0c46a3a4ae48ca79f5c6ce&role.id=8b8a4a451dc84c17bba824b2ff9cc4fe => generated 260 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:38:03.242282 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a743e41-5415-4444-8edb-f8b8bf99a518 None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:03.270838 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84c4f3c-61a1-41f7-9b79-c097774da399 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:03.271402 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84c4f3c-61a1-41f7-9b79-c097774da399 None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:03.271681 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84c4f3c-61a1-41f7-9b79-c097774da399 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:03.271955 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84c4f3c-61a1-41f7-9b79-c097774da399 None admin] PATH_INFO: `/v3/roles` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:03.272787 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84c4f3c-61a1-41f7-9b79-c097774da399 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:38:03.273797 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84c4f3c-61a1-41f7-9b79-c097774da399 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:38:03.275456 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84c4f3c-61a1-41f7-9b79-c097774da399 None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:38:03.287596 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 182/367] 10.222.0.93 () {56 vars in 1111 bytes} [Tue Jul 26 14:38:03 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:38:03.294229 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84c4f3c-61a1-41f7-9b79-c097774da399 None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:03.455028 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a743e41-5415-4444-8edb-f8b8bf99a518 None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:03.479896 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84c4f3c-61a1-41f7-9b79-c097774da399 None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:03.516182 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:38:03.524811 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd52035-af72-4e89-91cc-7eb6dea48201 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:03.526330 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd52035-af72-4e89-91cc-7eb6dea48201 None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:03.530945 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd52035-af72-4e89-91cc-7eb6dea48201 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:03.530945 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd52035-af72-4e89-91cc-7eb6dea48201 None admin] PATH_INFO: `/v3/users/34168efdd8ae4c8091a99077ad07c30b` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:03.531178 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f99ac8-91ba-44a4-862e-8d4e0a2e291a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:03.531284 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd52035-af72-4e89-91cc-7eb6dea48201 None admin] RBAC: Authorizing `identity:get_user(user_id=34168efdd8ae4c8091a99077ad07c30b)` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:38:03.531360 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f99ac8-91ba-44a4-862e-8d4e0a2e291a None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:03.531360 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f99ac8-91ba-44a4-862e-8d4e0a2e291a None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:03.531360 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f99ac8-91ba-44a4-862e-8d4e0a2e291a None admin] PATH_INFO: `/v3/projects/223cfb51fde24882a520cb183c0f36f8` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:03.532444 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f99ac8-91ba-44a4-862e-8d4e0a2e291a None admin] RBAC: Authorizing `identity:get_project(project_id=223cfb51fde24882a520cb183c0f36f8)` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:38:03.533113 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd52035-af72-4e89-91cc-7eb6dea48201 None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:38:03.534072 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f99ac8-91ba-44a4-862e-8d4e0a2e291a None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:38:03.536387 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 186/369] 10.222.0.93 () {56 vars in 1177 bytes} [Tue Jul 26 14:38:03 2022] GET /identity/v3/users/34168efdd8ae4c8091a99077ad07c30b => generated 293 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:38:03.536567 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 183/369] 10.222.0.93 () {56 vars in 1186 bytes} [Tue Jul 26 14:38:03 2022] GET /identity/v3/projects/223cfb51fde24882a520cb183c0f36f8 => generated 302 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:38:03.537350 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f99ac8-91ba-44a4-862e-8d4e0a2e291a None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:03.543442 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd52035-af72-4e89-91cc-7eb6dea48201 None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:03.589035 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:38:03.682471 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd52035-af72-4e89-91cc-7eb6dea48201 None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:03.735392 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7818d8a5-f7d9-40a9-9670-f76de8f10897 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:03.736148 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7818d8a5-f7d9-40a9-9670-f76de8f10897 None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:03.736566 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7818d8a5-f7d9-40a9-9670-f76de8f10897 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:03.736919 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7818d8a5-f7d9-40a9-9670-f76de8f10897 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:03.756355 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f99ac8-91ba-44a4-862e-8d4e0a2e291a None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:03.808828 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f635f7ab-ad47-41de-bbb3-220721510e48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:03.809569 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f635f7ab-ad47-41de-bbb3-220721510e48 None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:03.809933 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f635f7ab-ad47-41de-bbb3-220721510e48 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:03.810306 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f635f7ab-ad47-41de-bbb3-220721510e48 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:03.865320 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7818d8a5-f7d9-40a9-9670-f76de8f10897 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:38:03.867746 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7818d8a5-f7d9-40a9-9670-f76de8f10897 None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:38:03.914782 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:38:03.921441 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:38:03.933917 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f635f7ab-ad47-41de-bbb3-220721510e48 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:38:03.937038 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f635f7ab-ad47-41de-bbb3-220721510e48 None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:38:04.057375 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 187/370] 10.222.0.93 () {58 vars in 1282 bytes} [Tue Jul 26 14:38:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 514 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 14:38:04.059182 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7818d8a5-f7d9-40a9-9670-f76de8f10897 None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:04.136189 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 184/371] 10.222.0.93 () {58 vars in 1282 bytes} [Tue Jul 26 14:38:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 599 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 14:38:04.138071 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f635f7ab-ad47-41de-bbb3-220721510e48 None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:04.258633 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7818d8a5-f7d9-40a9-9670-f76de8f10897 None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:04.315143 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:38:04.316530 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:38:04.325674 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb8dae5-f0d0-4b68-9961-202eec407778 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:04.329574 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb8dae5-f0d0-4b68-9961-202eec407778 None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:04.329574 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb8dae5-f0d0-4b68-9961-202eec407778 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:04.329574 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb8dae5-f0d0-4b68-9961-202eec407778 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:04.329574 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb8dae5-f0d0-4b68-9961-202eec407778 None admin] RBAC: Adding query filter params (role.id=8b206d8d963645f6bd492384b6c5d39f, user.id=34168efdd8ae4c8091a99077ad07c30b, scope.system=all) {{(pid=87056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:38:04.330269 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb8dae5-f0d0-4b68-9961-202eec407778 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:38:04.332318 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb8dae5-f0d0-4b68-9961-202eec407778 None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:38:04.336165 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f635f7ab-ad47-41de-bbb3-220721510e48 None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:04.357740 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 188/372] 10.222.0.93 () {56 vars in 1308 bytes} [Tue Jul 26 14:38:04 2022] GET /identity/v3/role_assignments?user.id=34168efdd8ae4c8091a99077ad07c30b&scope.system=all&role.id=8b206d8d963645f6bd492384b6c5d39f => generated 510 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:38:04.359294 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb8dae5-f0d0-4b68-9961-202eec407778 None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:04.407385 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78eb8ac-79de-4a04-a5ac-78288fe3806a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:04.409104 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78eb8ac-79de-4a04-a5ac-78288fe3806a None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:04.409878 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78eb8ac-79de-4a04-a5ac-78288fe3806a None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:04.410623 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78eb8ac-79de-4a04-a5ac-78288fe3806a None admin] PATH_INFO: `/v3/groups/2c517fc77ff14f6680fe39decfb3c543` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:04.413350 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78eb8ac-79de-4a04-a5ac-78288fe3806a None admin] RBAC: Authorizing `identity:get_group(group_id=2c517fc77ff14f6680fe39decfb3c543)` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:38:04.416898 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78eb8ac-79de-4a04-a5ac-78288fe3806a None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:38:04.420959 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 185/373] 10.222.0.93 () {56 vars in 1180 bytes} [Tue Jul 26 14:38:04 2022] GET /identity/v3/groups/2c517fc77ff14f6680fe39decfb3c543 => generated 226 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:38:04.422850 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78eb8ac-79de-4a04-a5ac-78288fe3806a None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:04.617733 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78eb8ac-79de-4a04-a5ac-78288fe3806a None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:04.654204 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb8dae5-f0d0-4b68-9961-202eec407778 None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:04.705535 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50da7a24-2e93-423f-b677-5d435ceceabc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:04.707103 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50da7a24-2e93-423f-b677-5d435ceceabc None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:04.708049 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50da7a24-2e93-423f-b677-5d435ceceabc None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:04.708723 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50da7a24-2e93-423f-b677-5d435ceceabc None admin] PATH_INFO: `/v3/projects/f499667f2a194620a3504e461bf3cc25` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:04.711208 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50da7a24-2e93-423f-b677-5d435ceceabc None admin] RBAC: Authorizing `identity:get_project(project_id=f499667f2a194620a3504e461bf3cc25)` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:38:04.714442 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50da7a24-2e93-423f-b677-5d435ceceabc None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:38:04.718381 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 186/374] 10.222.0.93 () {56 vars in 1186 bytes} [Tue Jul 26 14:38:04 2022] GET /identity/v3/projects/f499667f2a194620a3504e461bf3cc25 => generated 344 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:38:04.720294 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50da7a24-2e93-423f-b677-5d435ceceabc None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:04.778942 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:38:04.809269 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e387624-a235-4dfa-8ffc-6a02176a3097 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:04.811208 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e387624-a235-4dfa-8ffc-6a02176a3097 None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:04.811980 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e387624-a235-4dfa-8ffc-6a02176a3097 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:04.812699 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e387624-a235-4dfa-8ffc-6a02176a3097 None admin] PATH_INFO: `/v3/projects/223cfb51fde24882a520cb183c0f36f8` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:04.815407 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e387624-a235-4dfa-8ffc-6a02176a3097 None admin] RBAC: Authorizing `identity:get_project(project_id=223cfb51fde24882a520cb183c0f36f8)` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:38:04.823006 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e387624-a235-4dfa-8ffc-6a02176a3097 None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:38:04.828318 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 189/375] 10.222.0.93 () {56 vars in 1186 bytes} [Tue Jul 26 14:38:04 2022] GET /identity/v3/projects/223cfb51fde24882a520cb183c0f36f8 => generated 302 bytes in 470 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:38:04.838448 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e387624-a235-4dfa-8ffc-6a02176a3097 None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:04.935602 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50da7a24-2e93-423f-b677-5d435ceceabc None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:04.974276 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:38:05.025018 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce9ddc3-cdd8-453d-b4fc-397cda346699 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:05.026048 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce9ddc3-cdd8-453d-b4fc-397cda346699 None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:05.026565 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce9ddc3-cdd8-453d-b4fc-397cda346699 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:05.027035 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce9ddc3-cdd8-453d-b4fc-397cda346699 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:05.029879 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce9ddc3-cdd8-453d-b4fc-397cda346699 None admin] RBAC: Adding query filter params (group.id=2c517fc77ff14f6680fe39decfb3c543, role.id=8b8a4a451dc84c17bba824b2ff9cc4fe, scope.project.id=223cfb51fde24882a520cb183c0f36f8) {{(pid=87055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:38:05.030461 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce9ddc3-cdd8-453d-b4fc-397cda346699 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:38:05.034452 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce9ddc3-cdd8-453d-b4fc-397cda346699 None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:38:05.047764 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 187/376] 10.222.0.93 () {56 vars in 1376 bytes} [Tue Jul 26 14:38:04 2022] GET /identity/v3/role_assignments?group.id=2c517fc77ff14f6680fe39decfb3c543&scope.project.id=223cfb51fde24882a520cb183c0f36f8&role.id=8b8a4a451dc84c17bba824b2ff9cc4fe => generated 260 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:38:05.049989 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce9ddc3-cdd8-453d-b4fc-397cda346699 None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:05.099336 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e387624-a235-4dfa-8ffc-6a02176a3097 None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:05.227957 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2e63b0-d609-4363-9889-84acd10ae294 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:05.229829 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2e63b0-d609-4363-9889-84acd10ae294 None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:05.233435 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2e63b0-d609-4363-9889-84acd10ae294 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:05.234989 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2e63b0-d609-4363-9889-84acd10ae294 None admin] PATH_INFO: `/v3/groups/ec734c7f48104755b00a395ee63f6634` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:05.253634 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2e63b0-d609-4363-9889-84acd10ae294 None admin] RBAC: Authorizing `identity:get_group(group_id=ec734c7f48104755b00a395ee63f6634)` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:38:05.259656 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2e63b0-d609-4363-9889-84acd10ae294 None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:38:05.263788 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 190/377] 10.222.0.93 () {56 vars in 1180 bytes} [Tue Jul 26 14:38:04 2022] GET /identity/v3/groups/ec734c7f48104755b00a395ee63f6634 => generated 229 bytes in 435 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:38:05.277871 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2e63b0-d609-4363-9889-84acd10ae294 None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:05.424757 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:38:05.448239 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce9ddc3-cdd8-453d-b4fc-397cda346699 None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:05.511944 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2e63b0-d609-4363-9889-84acd10ae294 None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:05.539970 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:38:05.544418 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bee2ed-041a-4ee2-bc15-85eface20446 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:05.545659 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bee2ed-041a-4ee2-bc15-85eface20446 None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:05.546142 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bee2ed-041a-4ee2-bc15-85eface20446 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:05.546625 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bee2ed-041a-4ee2-bc15-85eface20446 None admin] PATH_INFO: `/v3/groups/2c517fc77ff14f6680fe39decfb3c543` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:05.548953 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bee2ed-041a-4ee2-bc15-85eface20446 None admin] RBAC: Authorizing `identity:get_group(group_id=2c517fc77ff14f6680fe39decfb3c543)` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:38:05.551967 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bee2ed-041a-4ee2-bc15-85eface20446 None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:38:05.555564 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e2e79f-ca06-4cdb-978a-53ea6055331a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:05.556276 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 188/378] 10.222.0.93 () {56 vars in 1180 bytes} [Tue Jul 26 14:38:05 2022] GET /identity/v3/groups/2c517fc77ff14f6680fe39decfb3c543 => generated 226 bytes in 508 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:38:05.556855 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e2e79f-ca06-4cdb-978a-53ea6055331a None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:05.557362 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e2e79f-ca06-4cdb-978a-53ea6055331a None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:05.557862 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e2e79f-ca06-4cdb-978a-53ea6055331a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:05.558936 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e2e79f-ca06-4cdb-978a-53ea6055331a None admin] RBAC: Adding query filter params (group.id=ec734c7f48104755b00a395ee63f6634, role.id=94e105ff8ee4486abd501415cc05ba38, scope.project.id=f499667f2a194620a3504e461bf3cc25) {{(pid=87056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:38:05.559457 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e2e79f-ca06-4cdb-978a-53ea6055331a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:38:05.561312 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e2e79f-ca06-4cdb-978a-53ea6055331a None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:38:05.562628 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078b593a-4385-4723-ae5e-a9b95f16fa3f None None] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:05.562986 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078b593a-4385-4723-ae5e-a9b95f16fa3f None None] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:05.563273 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078b593a-4385-4723-ae5e-a9b95f16fa3f None None] PATH_INFO: `/` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:05.568398 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 189/379] 10.222.0.93 () {54 vars in 926 bytes} [Tue Jul 26 14:38:05 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:38:05.568398 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a039aec-6ea5-4703-96d3-ed25926056ee None None] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:05.568398 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a039aec-6ea5-4703-96d3-ed25926056ee None None] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:05.568398 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a039aec-6ea5-4703-96d3-ed25926056ee None None] PATH_INFO: `/` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:05.568398 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 190/380] 10.222.0.93 () {54 vars in 926 bytes} [Tue Jul 26 14:38:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:38:05.569255 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a039aec-6ea5-4703-96d3-ed25926056ee None None] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:05.574837 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 191/381] 10.222.0.93 () {56 vars in 1376 bytes} [Tue Jul 26 14:38:05 2022] GET /identity/v3/role_assignments?group.id=ec734c7f48104755b00a395ee63f6634&scope.project.id=f499667f2a194620a3504e461bf3cc25&role.id=94e105ff8ee4486abd501415cc05ba38 => generated 260 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:38:05.579594 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32bbb28-32af-435a-99ca-c7d664c33604 None None] REQUEST_METHOD: `POST` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:05.580095 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32bbb28-32af-435a-99ca-c7d664c33604 None None] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:05.580583 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32bbb28-32af-435a-99ca-c7d664c33604 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:05.613261 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.auth.core [None req-e32bbb28-32af-435a-99ca-c7d664c33604 None None] MFA Rules not processed for user `e5ef88cc058f425b882bcb87a1e1e75c`. Rule list: `[]` (Enabled: `True`). {{(pid=87056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:38:05.614601 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.fernet_utils [None req-e32bbb28-32af-435a-99ca-c7d664c33604 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:38:05.735041 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 192/382] 10.222.0.93 () {58 vars in 1023 bytes} [Tue Jul 26 14:38:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 14:38:05.736419 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78550bfd-fd29-4341-a062-8718636d45dc None None] REQUEST_METHOD: `POST` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:05.736841 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78550bfd-fd29-4341-a062-8718636d45dc None None] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:05.737149 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78550bfd-fd29-4341-a062-8718636d45dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:05.763820 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.auth.core [None req-78550bfd-fd29-4341-a062-8718636d45dc None None] MFA Rules not processed for user `e5ef88cc058f425b882bcb87a1e1e75c`. Rule list: `[]` (Enabled: `True`). {{(pid=87056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:38:05.765749 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.fernet_utils [None req-78550bfd-fd29-4341-a062-8718636d45dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:38:05.846331 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a039aec-6ea5-4703-96d3-ed25926056ee None None] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:05.895106 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 193/383] 10.222.0.93 () {58 vars in 1023 bytes} [Tue Jul 26 14:38:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 14:38:05.896550 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78550bfd-fd29-4341-a062-8718636d45dc None None] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:05.924872 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f215d1c9-60bf-43fd-94ee-b3654b1f7d1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:05.925743 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f215d1c9-60bf-43fd-94ee-b3654b1f7d1f None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:05.926123 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f215d1c9-60bf-43fd-94ee-b3654b1f7d1f None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:05.926518 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f215d1c9-60bf-43fd-94ee-b3654b1f7d1f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:05.927525 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f215d1c9-60bf-43fd-94ee-b3654b1f7d1f None admin] RBAC: Adding query filter params (group.id=2c517fc77ff14f6680fe39decfb3c543, role.id=ef1a806f8d774452a6536b57a4670ceb, scope.project.id=223cfb51fde24882a520cb183c0f36f8) {{(pid=87055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:38:05.927881 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f215d1c9-60bf-43fd-94ee-b3654b1f7d1f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:38:05.930532 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f215d1c9-60bf-43fd-94ee-b3654b1f7d1f None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:38:05.941747 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 191/384] 10.222.0.93 () {56 vars in 1376 bytes} [Tue Jul 26 14:38:05 2022] GET /identity/v3/role_assignments?group.id=2c517fc77ff14f6680fe39decfb3c543&scope.project.id=223cfb51fde24882a520cb183c0f36f8&role.id=ef1a806f8d774452a6536b57a4670ceb => generated 260 bytes in 373 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:38:05.963919 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f215d1c9-60bf-43fd-94ee-b3654b1f7d1f None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:05.981723 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:38:06.041940 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:38:06.076733 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78550bfd-fd29-4341-a062-8718636d45dc None None] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:06.143171 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91ff6f3-47c7-4ee7-a479-b20fd0eb4377 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:06.143934 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91ff6f3-47c7-4ee7-a479-b20fd0eb4377 None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:06.144222 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91ff6f3-47c7-4ee7-a479-b20fd0eb4377 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:06.144507 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91ff6f3-47c7-4ee7-a479-b20fd0eb4377 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:06.162268 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91ff6f3-47c7-4ee7-a479-b20fd0eb4377 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 14:38:06.169659 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application [None req-f91ff6f3-47c7-4ee7-a479-b20fd0eb4377 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 26 14:38:06.169659 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:38:06.169659 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:38:06.169659 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:38:06.169659 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:38:06.169659 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:38:06.169659 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:38:06.169659 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:38:06.169659 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:38:06.169659 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:38:06.169659 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:38:06.169659 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:38:06.169659 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 14:38:06.169659 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 14:38:06.169659 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 14:38:06.169659 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 14:38:06.170701 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 14:38:06.170701 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 14:38:06.170701 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 14:38:06.170701 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 14:38:06.170701 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:38:06.170701 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:38:06.170701 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:38:06.170701 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:38:06.170701 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:38:06.170701 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:38:06.170701 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:38:06.170701 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application with Lock( Jul 26 14:38:06.170701 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:38:06.170701 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:38:06.170701 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:38:06.170701 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:38:06.171915 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:38:06.171915 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:38:06.171915 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:38:06.171915 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:38:06.171915 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 14:38:06.171915 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 14:38:06.171915 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 14:38:06.171915 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 14:38:06.171915 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 14:38:06.171915 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 14:38:06.171915 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 26 14:38:06.171915 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Jul 26 14:38:06.171915 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 194/385] 10.222.0.93 () {56 vars in 1099 bytes} [Tue Jul 26 14:38:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:38:06.180684 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91ff6f3-47c7-4ee7-a479-b20fd0eb4377 None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:06.327155 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f215d1c9-60bf-43fd-94ee-b3654b1f7d1f None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:06.374980 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f2bbe7-28b3-4830-a32a-937e2b75dffd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:06.377781 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f2bbe7-28b3-4830-a32a-937e2b75dffd None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:06.377781 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f2bbe7-28b3-4830-a32a-937e2b75dffd None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:06.377781 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f2bbe7-28b3-4830-a32a-937e2b75dffd None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:06.394035 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91ff6f3-47c7-4ee7-a479-b20fd0eb4377 None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:06.402699 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f2bbe7-28b3-4830-a32a-937e2b75dffd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 14:38:06.414474 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application [None req-31f2bbe7-28b3-4830-a32a-937e2b75dffd None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 14:38:06.414474 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:38:06.414474 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:38:06.414474 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:38:06.414474 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:38:06.414474 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:38:06.414474 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:38:06.414474 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:38:06.414474 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:38:06.414474 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:38:06.414474 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:38:06.414474 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:38:06.414474 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 14:38:06.414474 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 14:38:06.414474 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 14:38:06.414474 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 14:38:06.416908 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 14:38:06.416908 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 14:38:06.416908 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 14:38:06.416908 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 14:38:06.416908 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:38:06.416908 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:38:06.416908 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:38:06.416908 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:38:06.416908 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:38:06.416908 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:38:06.416908 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:38:06.416908 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application with Lock( Jul 26 14:38:06.416908 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:38:06.416908 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:38:06.416908 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:38:06.416908 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:38:06.417808 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:38:06.417808 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:38:06.417808 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:38:06.417808 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:38:06.417808 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 14:38:06.417808 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 14:38:06.417808 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 14:38:06.417808 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 14:38:06.417808 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 14:38:06.417808 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 14:38:06.417808 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 14:38:06.417808 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Jul 26 14:38:06.417808 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 192/386] 10.222.0.93 () {56 vars in 1114 bytes} [Tue Jul 26 14:38:05 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 453 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:38:06.418498 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:38:06.422336 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f2bbe7-28b3-4830-a32a-937e2b75dffd None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:06.532068 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:38:06.551550 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6164e7f-a4f5-47e0-9d13-fb144bd8aac6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:06.552614 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6164e7f-a4f5-47e0-9d13-fb144bd8aac6 None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:06.553105 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6164e7f-a4f5-47e0-9d13-fb144bd8aac6 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:06.553591 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6164e7f-a4f5-47e0-9d13-fb144bd8aac6 None admin] PATH_INFO: `/v3/roles` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:06.555512 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6164e7f-a4f5-47e0-9d13-fb144bd8aac6 None admin] RBAC: Adding query filter params (name=member) {{(pid=87056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:38:06.556059 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6164e7f-a4f5-47e0-9d13-fb144bd8aac6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:38:06.558710 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6164e7f-a4f5-47e0-9d13-fb144bd8aac6 None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:38:06.559626 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f2bbe7-28b3-4830-a32a-937e2b75dffd None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:06.584670 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 195/387] 10.222.0.93 () {56 vars in 1101 bytes} [Tue Jul 26 14:38:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 405 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:38:06.594165 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6164e7f-a4f5-47e0-9d13-fb144bd8aac6 None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:06.608267 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c37b8d-d1c3-4313-bcb8-2ef0ef24e049 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:06.608906 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c37b8d-d1c3-4313-bcb8-2ef0ef24e049 None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:06.609186 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c37b8d-d1c3-4313-bcb8-2ef0ef24e049 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:06.609458 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c37b8d-d1c3-4313-bcb8-2ef0ef24e049 None admin] PATH_INFO: `/v3/roles` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:06.610189 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c37b8d-d1c3-4313-bcb8-2ef0ef24e049 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:38:06.610535 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c37b8d-d1c3-4313-bcb8-2ef0ef24e049 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:38:06.612174 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c37b8d-d1c3-4313-bcb8-2ef0ef24e049 None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:38:06.630327 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 193/388] 10.222.0.93 () {56 vars in 1111 bytes} [Tue Jul 26 14:38:06 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:38:06.640315 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c37b8d-d1c3-4313-bcb8-2ef0ef24e049 None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:06.863584 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c37b8d-d1c3-4313-bcb8-2ef0ef24e049 None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:06.868924 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6164e7f-a4f5-47e0-9d13-fb144bd8aac6 None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:06.903440 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294c3694-c9cc-4aeb-8bb2-5e4ae260bc18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:06.904101 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294c3694-c9cc-4aeb-8bb2-5e4ae260bc18 None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:06.904382 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294c3694-c9cc-4aeb-8bb2-5e4ae260bc18 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:06.904655 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294c3694-c9cc-4aeb-8bb2-5e4ae260bc18 None admin] PATH_INFO: `/v3/groups/2c517fc77ff14f6680fe39decfb3c543` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:06.906052 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294c3694-c9cc-4aeb-8bb2-5e4ae260bc18 None admin] RBAC: Authorizing `identity:get_group(group_id=2c517fc77ff14f6680fe39decfb3c543)` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:38:06.907819 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294c3694-c9cc-4aeb-8bb2-5e4ae260bc18 None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:38:06.909871 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 194/389] 10.222.0.93 () {56 vars in 1180 bytes} [Tue Jul 26 14:38:06 2022] GET /identity/v3/groups/2c517fc77ff14f6680fe39decfb3c543 => generated 226 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:38:06.916000 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294c3694-c9cc-4aeb-8bb2-5e4ae260bc18 None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:06.948477 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e6b1f5-eeeb-496a-9f6a-7d972148e556 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:06.949592 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e6b1f5-eeeb-496a-9f6a-7d972148e556 None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:06.950121 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e6b1f5-eeeb-496a-9f6a-7d972148e556 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:06.950629 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e6b1f5-eeeb-496a-9f6a-7d972148e556 None admin] PATH_INFO: `/v3/groups/2c517fc77ff14f6680fe39decfb3c543` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:06.958716 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e6b1f5-eeeb-496a-9f6a-7d972148e556 None admin] RBAC: Authorizing `identity:get_group(group_id=2c517fc77ff14f6680fe39decfb3c543)` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:38:06.961807 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e6b1f5-eeeb-496a-9f6a-7d972148e556 None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:38:06.966192 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 196/390] 10.222.0.93 () {56 vars in 1180 bytes} [Tue Jul 26 14:38:06 2022] GET /identity/v3/groups/2c517fc77ff14f6680fe39decfb3c543 => generated 226 bytes in 373 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:38:06.968218 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:38:06.975951 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e6b1f5-eeeb-496a-9f6a-7d972148e556 None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:07.077058 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294c3694-c9cc-4aeb-8bb2-5e4ae260bc18 None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:07.102335 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:38:07.176022 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6682f98d-095f-4793-b2d3-b11fdf59d7fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:07.177266 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6682f98d-095f-4793-b2d3-b11fdf59d7fe None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:07.177788 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6682f98d-095f-4793-b2d3-b11fdf59d7fe None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:07.178344 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6682f98d-095f-4793-b2d3-b11fdf59d7fe None admin] PATH_INFO: `/v3/projects/798795388b0c46a3a4ae48ca79f5c6ce` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:07.181311 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6682f98d-095f-4793-b2d3-b11fdf59d7fe None admin] RBAC: Authorizing `identity:get_project(project_id=798795388b0c46a3a4ae48ca79f5c6ce)` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:38:07.183939 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6682f98d-095f-4793-b2d3-b11fdf59d7fe None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:38:07.187572 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 195/391] 10.222.0.93 () {56 vars in 1186 bytes} [Tue Jul 26 14:38:06 2022] GET /identity/v3/projects/798795388b0c46a3a4ae48ca79f5c6ce => generated 298 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:38:07.197073 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6682f98d-095f-4793-b2d3-b11fdf59d7fe None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:07.244413 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e6b1f5-eeeb-496a-9f6a-7d972148e556 None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:07.292399 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b7a64a-e9e3-4637-b3da-4d657fc9346c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:07.293510 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b7a64a-e9e3-4637-b3da-4d657fc9346c None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:07.294002 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b7a64a-e9e3-4637-b3da-4d657fc9346c None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:07.294523 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b7a64a-e9e3-4637-b3da-4d657fc9346c None admin] PATH_INFO: `/v3/projects/798795388b0c46a3a4ae48ca79f5c6ce` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:07.296826 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b7a64a-e9e3-4637-b3da-4d657fc9346c None admin] RBAC: Authorizing `identity:get_project(project_id=798795388b0c46a3a4ae48ca79f5c6ce)` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:38:07.298793 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b7a64a-e9e3-4637-b3da-4d657fc9346c None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:38:07.301847 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 197/392] 10.222.0.93 () {56 vars in 1186 bytes} [Tue Jul 26 14:38:06 2022] GET /identity/v3/projects/798795388b0c46a3a4ae48ca79f5c6ce => generated 298 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:38:07.308143 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b7a64a-e9e3-4637-b3da-4d657fc9346c None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:07.420867 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:38:07.483495 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6682f98d-095f-4793-b2d3-b11fdf59d7fe None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:07.532598 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b7a64a-e9e3-4637-b3da-4d657fc9346c None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:07.535606 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:38:07.556119 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6ec6b9-9a56-4fe7-9572-fe8154b94ba0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:07.557276 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6ec6b9-9a56-4fe7-9572-fe8154b94ba0 None admin] REQUEST_METHOD: `PUT` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:07.557769 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6ec6b9-9a56-4fe7-9572-fe8154b94ba0 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:07.558294 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6ec6b9-9a56-4fe7-9572-fe8154b94ba0 None admin] PATH_INFO: `/v3/projects/798795388b0c46a3a4ae48ca79f5c6ce/groups/2c517fc77ff14f6680fe39decfb3c543/roles/ef1a806f8d774452a6536b57a4670ceb` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:07.562681 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6ec6b9-9a56-4fe7-9572-fe8154b94ba0 None admin] RBAC: Authorizing `identity:create_grant(project_id=798795388b0c46a3a4ae48ca79f5c6ce, group_id=2c517fc77ff14f6680fe39decfb3c543, role_id=ef1a806f8d774452a6536b57a4670ceb)` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:38:07.565262 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6ec6b9-9a56-4fe7-9572-fe8154b94ba0 None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:38:07.622540 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df53543-f36e-4ea7-9621-8da40d79db0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:07.623787 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df53543-f36e-4ea7-9621-8da40d79db0b None admin] REQUEST_METHOD: `PUT` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:07.624350 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df53543-f36e-4ea7-9621-8da40d79db0b None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:07.624851 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df53543-f36e-4ea7-9621-8da40d79db0b None admin] PATH_INFO: `/v3/projects/798795388b0c46a3a4ae48ca79f5c6ce/groups/2c517fc77ff14f6680fe39decfb3c543/roles/8b8a4a451dc84c17bba824b2ff9cc4fe` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:07.629017 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df53543-f36e-4ea7-9621-8da40d79db0b None admin] RBAC: Authorizing `identity:create_grant(project_id=798795388b0c46a3a4ae48ca79f5c6ce, group_id=2c517fc77ff14f6680fe39decfb3c543, role_id=8b8a4a451dc84c17bba824b2ff9cc4fe)` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:38:07.631895 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df53543-f36e-4ea7-9621-8da40d79db0b None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:38:07.713682 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 196/393] 10.222.0.93 () {58 vars in 1442 bytes} [Tue Jul 26 14:38:07 2022] PUT /identity/v3/projects/798795388b0c46a3a4ae48ca79f5c6ce/groups/2c517fc77ff14f6680fe39decfb3c543/roles/ef1a806f8d774452a6536b57a4670ceb => generated 0 bytes in 517 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 14:38:07.768097 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 198/394] 10.222.0.93 () {58 vars in 1442 bytes} [Tue Jul 26 14:38:07 2022] PUT /identity/v3/projects/798795388b0c46a3a4ae48ca79f5c6ce/groups/2c517fc77ff14f6680fe39decfb3c543/roles/8b8a4a451dc84c17bba824b2ff9cc4fe => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 14:38:08.533820 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831b3b67-2aa2-45a2-8dc0-702d2a66082a None None] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:08.534407 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831b3b67-2aa2-45a2-8dc0-702d2a66082a None None] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:08.534407 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831b3b67-2aa2-45a2-8dc0-702d2a66082a None None] PATH_INFO: `/` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:08.535959 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 197/395] 10.222.0.93 () {54 vars in 926 bytes} [Tue Jul 26 14:38:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:38:08.543306 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bf1317-2c3a-40a8-b1ec-0c30f7cd1c13 None None] REQUEST_METHOD: `POST` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:08.544306 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bf1317-2c3a-40a8-b1ec-0c30f7cd1c13 None None] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:08.544777 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bf1317-2c3a-40a8-b1ec-0c30f7cd1c13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:08.565736 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.auth.core [None req-24bf1317-2c3a-40a8-b1ec-0c30f7cd1c13 None None] MFA Rules not processed for user `e5ef88cc058f425b882bcb87a1e1e75c`. Rule list: `[]` (Enabled: `True`). {{(pid=87056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:38:08.567488 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.fernet_utils [None req-24bf1317-2c3a-40a8-b1ec-0c30f7cd1c13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:38:08.690059 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 199/396] 10.222.0.93 () {58 vars in 1023 bytes} [Tue Jul 26 14:38:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 14:38:08.727500 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831b3b67-2aa2-45a2-8dc0-702d2a66082a None None] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:08.764460 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd426d73-34b9-4c4e-925c-1eb499a4dde4 None None] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:08.764951 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd426d73-34b9-4c4e-925c-1eb499a4dde4 None None] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:08.765429 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd426d73-34b9-4c4e-925c-1eb499a4dde4 None None] PATH_INFO: `/` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:08.767893 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 200/397] 10.222.0.93 () {54 vars in 926 bytes} [Tue Jul 26 14:38:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:38:08.790366 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7defde64-e5cf-4b7f-90bd-6da3f55dd972 None None] REQUEST_METHOD: `POST` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:08.790658 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7defde64-e5cf-4b7f-90bd-6da3f55dd972 None None] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:08.790859 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7defde64-e5cf-4b7f-90bd-6da3f55dd972 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:08.837469 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.auth.core [None req-7defde64-e5cf-4b7f-90bd-6da3f55dd972 None None] MFA Rules not processed for user `e5ef88cc058f425b882bcb87a1e1e75c`. Rule list: `[]` (Enabled: `True`). {{(pid=87056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:38:08.839123 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.fernet_utils [None req-7defde64-e5cf-4b7f-90bd-6da3f55dd972 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:38:08.933955 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 201/398] 10.222.0.93 () {58 vars in 1023 bytes} [Tue Jul 26 14:38:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 14:38:08.935468 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a92e1c-8d01-4bac-9174-8cb2dcd0f40e None None] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:08.935717 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a92e1c-8d01-4bac-9174-8cb2dcd0f40e None None] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:08.935995 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a92e1c-8d01-4bac-9174-8cb2dcd0f40e None None] PATH_INFO: `/` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:08.942154 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 202/399] 10.222.0.93 () {54 vars in 926 bytes} [Tue Jul 26 14:38:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:38:08.943873 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f85fb06-82e5-48b8-a543-c3d94b62657f None None] REQUEST_METHOD: `POST` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:08.944199 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f85fb06-82e5-48b8-a543-c3d94b62657f None None] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:08.944472 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f85fb06-82e5-48b8-a543-c3d94b62657f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:08.967309 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.auth.core [None req-7f85fb06-82e5-48b8-a543-c3d94b62657f None None] MFA Rules not processed for user `e5ef88cc058f425b882bcb87a1e1e75c`. Rule list: `[]` (Enabled: `True`). {{(pid=87056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:38:08.968675 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.fernet_utils [None req-7f85fb06-82e5-48b8-a543-c3d94b62657f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:38:08.993855 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831b3b67-2aa2-45a2-8dc0-702d2a66082a None None] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:09.002821 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:38:09.067953 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb3a705-80bf-4e49-abba-91116208254e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:09.068910 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb3a705-80bf-4e49-abba-91116208254e None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:09.069597 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb3a705-80bf-4e49-abba-91116208254e None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:09.070644 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb3a705-80bf-4e49-abba-91116208254e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:09.095460 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb3a705-80bf-4e49-abba-91116208254e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 14:38:09.104924 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application [None req-5cb3a705-80bf-4e49-abba-91116208254e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 14:38:09.104924 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:38:09.104924 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:38:09.104924 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:38:09.104924 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:38:09.104924 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:38:09.104924 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:38:09.104924 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:38:09.104924 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:38:09.104924 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:38:09.104924 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:38:09.104924 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:38:09.104924 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 14:38:09.104924 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 14:38:09.104924 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 14:38:09.104924 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 14:38:09.105901 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 14:38:09.105901 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 14:38:09.105901 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 14:38:09.105901 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 14:38:09.105901 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:38:09.105901 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:38:09.105901 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:38:09.105901 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:38:09.105901 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:38:09.105901 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:38:09.105901 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:38:09.105901 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application with Lock( Jul 26 14:38:09.105901 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:38:09.105901 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:38:09.105901 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:38:09.105901 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:38:09.106736 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:38:09.106736 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:38:09.106736 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:38:09.106736 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:38:09.106736 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 14:38:09.106736 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 14:38:09.106736 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 14:38:09.106736 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 14:38:09.106736 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 14:38:09.106736 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 14:38:09.106736 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 14:38:09.106736 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Jul 26 14:38:09.109254 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 198/400] 10.222.0.93 () {56 vars in 1096 bytes} [Tue Jul 26 14:38:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 382 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:38:09.109429 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 203/401] 10.222.0.93 () {58 vars in 1023 bytes} [Tue Jul 26 14:38:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 14:38:09.109508 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb3a705-80bf-4e49-abba-91116208254e None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:09.114178 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f85fb06-82e5-48b8-a543-c3d94b62657f None None] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:09.126516 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:38:09.295122 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb3a705-80bf-4e49-abba-91116208254e None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:09.306055 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f85fb06-82e5-48b8-a543-c3d94b62657f None None] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:09.360974 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9dde61-9a85-4256-bc8d-9adafb6a17c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:09.361998 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9dde61-9a85-4256-bc8d-9adafb6a17c8 None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:09.362512 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9dde61-9a85-4256-bc8d-9adafb6a17c8 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:09.362987 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9dde61-9a85-4256-bc8d-9adafb6a17c8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:09.375077 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af53c64-d1f8-41da-9c6f-4cd375eca711 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:09.376323 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af53c64-d1f8-41da-9c6f-4cd375eca711 None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:09.377209 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af53c64-d1f8-41da-9c6f-4cd375eca711 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:09.377680 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af53c64-d1f8-41da-9c6f-4cd375eca711 None admin] PATH_INFO: `/v3/roles` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:09.378979 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af53c64-d1f8-41da-9c6f-4cd375eca711 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:38:09.379481 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af53c64-d1f8-41da-9c6f-4cd375eca711 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:38:09.382915 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af53c64-d1f8-41da-9c6f-4cd375eca711 None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:38:09.383069 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9dde61-9a85-4256-bc8d-9adafb6a17c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 14:38:09.394960 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application [None req-af9dde61-9a85-4256-bc8d-9adafb6a17c8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 14:38:09.394960 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:38:09.394960 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:38:09.394960 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:38:09.394960 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:38:09.394960 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:38:09.394960 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:38:09.394960 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:38:09.394960 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:38:09.394960 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:38:09.394960 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:38:09.394960 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:38:09.394960 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 14:38:09.394960 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 14:38:09.394960 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 14:38:09.394960 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 14:38:09.399033 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 14:38:09.399033 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 14:38:09.399033 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 14:38:09.399033 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 14:38:09.399033 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:38:09.399033 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:38:09.399033 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:38:09.399033 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:38:09.399033 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:38:09.399033 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:38:09.399033 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:38:09.399033 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application with Lock( Jul 26 14:38:09.399033 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:38:09.399033 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:38:09.399033 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:38:09.399033 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:38:09.400033 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:38:09.400033 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:38:09.400033 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:38:09.400033 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:38:09.400033 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 14:38:09.400033 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 14:38:09.400033 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 14:38:09.400033 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 14:38:09.400033 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 14:38:09.400033 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 14:38:09.400033 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 14:38:09.400033 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Jul 26 14:38:09.400033 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 199/402] 10.222.0.93 () {56 vars in 1114 bytes} [Tue Jul 26 14:38:09 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:38:09.400715 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9dde61-9a85-4256-bc8d-9adafb6a17c8 None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:09.402503 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 204/403] 10.222.0.93 () {56 vars in 1099 bytes} [Tue Jul 26 14:38:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:38:09.408387 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af53c64-d1f8-41da-9c6f-4cd375eca711 None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:09.460111 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:38:09.544395 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:38:09.622019 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af53c64-d1f8-41da-9c6f-4cd375eca711 None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:09.645832 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9dde61-9a85-4256-bc8d-9adafb6a17c8 None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:09.704575 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864d098c-75ac-4a35-b859-b6bbcf5666ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:09.706112 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864d098c-75ac-4a35-b859-b6bbcf5666ad None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:09.707022 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864d098c-75ac-4a35-b859-b6bbcf5666ad None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:09.707956 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864d098c-75ac-4a35-b859-b6bbcf5666ad None admin] PATH_INFO: `/v3/roles` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:09.709552 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864d098c-75ac-4a35-b859-b6bbcf5666ad None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:38:09.711135 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864d098c-75ac-4a35-b859-b6bbcf5666ad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:38:09.714337 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864d098c-75ac-4a35-b859-b6bbcf5666ad None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:38:09.738813 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 205/404] 10.222.0.93 () {56 vars in 1111 bytes} [Tue Jul 26 14:38:09 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:38:09.740328 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864d098c-75ac-4a35-b859-b6bbcf5666ad None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:09.745292 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd2f263-f5f5-41b8-ae8f-5438e2e6e901 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:09.746454 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd2f263-f5f5-41b8-ae8f-5438e2e6e901 None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:09.746967 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd2f263-f5f5-41b8-ae8f-5438e2e6e901 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:09.747467 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd2f263-f5f5-41b8-ae8f-5438e2e6e901 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:09.775704 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd2f263-f5f5-41b8-ae8f-5438e2e6e901 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 14:38:09.790185 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application [None req-1dd2f263-f5f5-41b8-ae8f-5438e2e6e901 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 26 14:38:09.790185 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:38:09.790185 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:38:09.790185 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:38:09.790185 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:38:09.790185 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:38:09.790185 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:38:09.790185 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:38:09.790185 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:38:09.790185 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:38:09.790185 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:38:09.790185 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:38:09.790185 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 14:38:09.790185 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 14:38:09.790185 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 14:38:09.790185 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 14:38:09.791992 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 14:38:09.791992 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 14:38:09.791992 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 14:38:09.791992 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 14:38:09.791992 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:38:09.791992 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:38:09.791992 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:38:09.791992 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:38:09.791992 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:38:09.791992 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:38:09.791992 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:38:09.791992 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application with Lock( Jul 26 14:38:09.791992 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:38:09.791992 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:38:09.791992 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:38:09.791992 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:38:09.793542 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:38:09.793542 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:38:09.793542 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:38:09.793542 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:38:09.793542 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 14:38:09.793542 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 14:38:09.793542 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 14:38:09.793542 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 14:38:09.793542 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 14:38:09.793542 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 14:38:09.793542 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 26 14:38:09.793542 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Jul 26 14:38:09.793542 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 200/405] 10.222.0.93 () {56 vars in 1099 bytes} [Tue Jul 26 14:38:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 394 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:38:09.794787 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd2f263-f5f5-41b8-ae8f-5438e2e6e901 None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:09.954208 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:38:10.008124 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864d098c-75ac-4a35-b859-b6bbcf5666ad None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:10.012738 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd2f263-f5f5-41b8-ae8f-5438e2e6e901 None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:10.065290 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:38:10.088659 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a75653-e49e-487e-bc54-f62179843808 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:10.089885 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2edb3ee-ad36-4883-9bb3-dfa5c67eabe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:10.090423 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a75653-e49e-487e-bc54-f62179843808 None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:10.091124 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a75653-e49e-487e-bc54-f62179843808 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:10.091437 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2edb3ee-ad36-4883-9bb3-dfa5c67eabe2 None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:10.091946 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a75653-e49e-487e-bc54-f62179843808 None admin] PATH_INFO: `/v3/groups/2c517fc77ff14f6680fe39decfb3c543` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:10.092123 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2edb3ee-ad36-4883-9bb3-dfa5c67eabe2 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:10.092740 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2edb3ee-ad36-4883-9bb3-dfa5c67eabe2 None admin] PATH_INFO: `/v3/groups/ec734c7f48104755b00a395ee63f6634` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:10.095095 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2edb3ee-ad36-4883-9bb3-dfa5c67eabe2 None admin] RBAC: Authorizing `identity:get_group(group_id=ec734c7f48104755b00a395ee63f6634)` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:38:10.095363 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a75653-e49e-487e-bc54-f62179843808 None admin] RBAC: Authorizing `identity:get_group(group_id=2c517fc77ff14f6680fe39decfb3c543)` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:38:10.097862 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a75653-e49e-487e-bc54-f62179843808 None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:38:10.098216 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2edb3ee-ad36-4883-9bb3-dfa5c67eabe2 None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:38:10.102032 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 201/406] 10.222.0.93 () {56 vars in 1180 bytes} [Tue Jul 26 14:38:09 2022] GET /identity/v3/groups/2c517fc77ff14f6680fe39decfb3c543 => generated 226 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:38:10.111012 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 206/407] 10.222.0.93 () {56 vars in 1180 bytes} [Tue Jul 26 14:38:09 2022] GET /identity/v3/groups/ec734c7f48104755b00a395ee63f6634 => generated 229 bytes in 372 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:38:10.112153 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a75653-e49e-487e-bc54-f62179843808 None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:10.114213 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2edb3ee-ad36-4883-9bb3-dfa5c67eabe2 None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:10.317746 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a75653-e49e-487e-bc54-f62179843808 None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:10.357885 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2edb3ee-ad36-4883-9bb3-dfa5c67eabe2 None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:10.384312 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c2c571-4db1-4535-bd46-863b45d00866 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:10.385168 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c2c571-4db1-4535-bd46-863b45d00866 None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:10.389151 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c2c571-4db1-4535-bd46-863b45d00866 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:10.389151 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c2c571-4db1-4535-bd46-863b45d00866 None admin] PATH_INFO: `/v3/roles` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:10.389151 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c2c571-4db1-4535-bd46-863b45d00866 None admin] RBAC: Adding query filter params (name=member) {{(pid=87055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:38:10.389151 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c2c571-4db1-4535-bd46-863b45d00866 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:38:10.390009 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c2c571-4db1-4535-bd46-863b45d00866 None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:38:10.405813 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 202/408] 10.222.0.93 () {56 vars in 1101 bytes} [Tue Jul 26 14:38:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:38:10.407889 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c2c571-4db1-4535-bd46-863b45d00866 None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:10.433750 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325e76b2-1f09-4735-b66b-8e563fce8cdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:10.435357 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325e76b2-1f09-4735-b66b-8e563fce8cdf None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:10.436005 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325e76b2-1f09-4735-b66b-8e563fce8cdf None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:10.436635 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325e76b2-1f09-4735-b66b-8e563fce8cdf None admin] PATH_INFO: `/v3/projects/f499667f2a194620a3504e461bf3cc25` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:10.439183 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325e76b2-1f09-4735-b66b-8e563fce8cdf None admin] RBAC: Authorizing `identity:get_project(project_id=f499667f2a194620a3504e461bf3cc25)` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:38:10.442358 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325e76b2-1f09-4735-b66b-8e563fce8cdf None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:38:10.446160 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 207/409] 10.222.0.93 () {56 vars in 1186 bytes} [Tue Jul 26 14:38:10 2022] GET /identity/v3/projects/f499667f2a194620a3504e461bf3cc25 => generated 344 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:38:10.448075 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325e76b2-1f09-4735-b66b-8e563fce8cdf None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:10.481890 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:38:10.518846 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:38:10.597055 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c2c571-4db1-4535-bd46-863b45d00866 None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:10.645129 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325e76b2-1f09-4735-b66b-8e563fce8cdf None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:10.650916 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee415bf-fb5a-43e1-addf-13ae40ad88ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:10.652021 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee415bf-fb5a-43e1-addf-13ae40ad88ab None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:10.652513 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee415bf-fb5a-43e1-addf-13ae40ad88ab None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:10.653013 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee415bf-fb5a-43e1-addf-13ae40ad88ab None admin] PATH_INFO: `/v3/projects/223cfb51fde24882a520cb183c0f36f8` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:10.655340 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee415bf-fb5a-43e1-addf-13ae40ad88ab None admin] RBAC: Authorizing `identity:get_project(project_id=223cfb51fde24882a520cb183c0f36f8)` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:38:10.658469 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee415bf-fb5a-43e1-addf-13ae40ad88ab None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:38:10.661973 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 203/410] 10.222.0.93 () {56 vars in 1186 bytes} [Tue Jul 26 14:38:10 2022] GET /identity/v3/projects/223cfb51fde24882a520cb183c0f36f8 => generated 302 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:38:10.663406 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee415bf-fb5a-43e1-addf-13ae40ad88ab None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:10.689100 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7780d8f0-9dc5-4933-b288-b31ce9005d9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:10.689782 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7780d8f0-9dc5-4933-b288-b31ce9005d9c None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:10.690125 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7780d8f0-9dc5-4933-b288-b31ce9005d9c None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:10.690424 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7780d8f0-9dc5-4933-b288-b31ce9005d9c None admin] PATH_INFO: `/v3/groups/2c517fc77ff14f6680fe39decfb3c543` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:10.691654 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7780d8f0-9dc5-4933-b288-b31ce9005d9c None admin] RBAC: Authorizing `identity:get_group(group_id=2c517fc77ff14f6680fe39decfb3c543)` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:38:10.693154 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7780d8f0-9dc5-4933-b288-b31ce9005d9c None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:38:10.695648 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 208/411] 10.222.0.93 () {56 vars in 1180 bytes} [Tue Jul 26 14:38:10 2022] GET /identity/v3/groups/2c517fc77ff14f6680fe39decfb3c543 => generated 226 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:38:10.696999 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e05a9c4-7eeb-4a96-8456-d8d6b56292ef None None] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:10.697293 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e05a9c4-7eeb-4a96-8456-d8d6b56292ef None None] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:10.697597 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e05a9c4-7eeb-4a96-8456-d8d6b56292ef None None] PATH_INFO: `/` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:10.699362 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 209/412] 10.222.0.93 () {54 vars in 926 bytes} [Tue Jul 26 14:38:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:38:10.700360 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258f45df-6de1-4552-8ac3-d78348d6a2bf None None] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:10.700646 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258f45df-6de1-4552-8ac3-d78348d6a2bf None None] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:10.700922 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258f45df-6de1-4552-8ac3-d78348d6a2bf None None] PATH_INFO: `/` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:10.707162 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 210/413] 10.222.0.93 () {54 vars in 926 bytes} [Tue Jul 26 14:38:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:38:10.707162 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258f45df-6de1-4552-8ac3-d78348d6a2bf None None] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:10.830881 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee415bf-fb5a-43e1-addf-13ae40ad88ab None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:10.846675 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:38:10.867296 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:38:10.876182 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258f45df-6de1-4552-8ac3-d78348d6a2bf None None] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:10.885448 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3a952b-3528-438a-98e2-b236014b3a8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:10.886294 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3a952b-3528-438a-98e2-b236014b3a8b None admin] REQUEST_METHOD: `PUT` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:10.886701 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3a952b-3528-438a-98e2-b236014b3a8b None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:10.887086 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3a952b-3528-438a-98e2-b236014b3a8b None admin] PATH_INFO: `/v3/projects/f499667f2a194620a3504e461bf3cc25/groups/ec734c7f48104755b00a395ee63f6634/roles/94e105ff8ee4486abd501415cc05ba38` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:10.889661 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3a952b-3528-438a-98e2-b236014b3a8b None admin] RBAC: Authorizing `identity:create_grant(project_id=f499667f2a194620a3504e461bf3cc25, group_id=ec734c7f48104755b00a395ee63f6634, role_id=94e105ff8ee4486abd501415cc05ba38)` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:38:10.891593 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3a952b-3528-438a-98e2-b236014b3a8b None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:38:10.921301 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b68468d-e1bd-466b-9b3e-2fec6a4ef413 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:10.922040 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b68468d-e1bd-466b-9b3e-2fec6a4ef413 None admin] REQUEST_METHOD: `PUT` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:10.922411 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b68468d-e1bd-466b-9b3e-2fec6a4ef413 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:10.922729 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b68468d-e1bd-466b-9b3e-2fec6a4ef413 None admin] PATH_INFO: `/v3/projects/223cfb51fde24882a520cb183c0f36f8/groups/2c517fc77ff14f6680fe39decfb3c543/roles/ef1a806f8d774452a6536b57a4670ceb` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:10.925097 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b68468d-e1bd-466b-9b3e-2fec6a4ef413 None admin] RBAC: Authorizing `identity:create_grant(project_id=223cfb51fde24882a520cb183c0f36f8, group_id=2c517fc77ff14f6680fe39decfb3c543, role_id=ef1a806f8d774452a6536b57a4670ceb)` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:38:10.926746 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b68468d-e1bd-466b-9b3e-2fec6a4ef413 None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:38:11.010121 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 204/414] 10.222.0.93 () {58 vars in 1442 bytes} [Tue Jul 26 14:38:10 2022] PUT /identity/v3/projects/f499667f2a194620a3504e461bf3cc25/groups/ec734c7f48104755b00a395ee63f6634/roles/94e105ff8ee4486abd501415cc05ba38 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 14:38:11.011613 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3a952b-3528-438a-98e2-b236014b3a8b None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:11.034039 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 211/415] 10.222.0.93 () {58 vars in 1442 bytes} [Tue Jul 26 14:38:10 2022] PUT /identity/v3/projects/223cfb51fde24882a520cb183c0f36f8/groups/2c517fc77ff14f6680fe39decfb3c543/roles/ef1a806f8d774452a6536b57a4670ceb => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 14:38:11.034039 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53e27bc-cd90-4df3-b132-728fc0b7d21d None None] REQUEST_METHOD: `POST` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:11.034039 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53e27bc-cd90-4df3-b132-728fc0b7d21d None None] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:11.034039 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53e27bc-cd90-4df3-b132-728fc0b7d21d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:11.078587 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.auth.core [None req-c53e27bc-cd90-4df3-b132-728fc0b7d21d None None] MFA Rules not processed for user `e5ef88cc058f425b882bcb87a1e1e75c`. Rule list: `[]` (Enabled: `True`). {{(pid=87056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:38:11.080870 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.fernet_utils [None req-c53e27bc-cd90-4df3-b132-728fc0b7d21d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:38:11.221327 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3a952b-3528-438a-98e2-b236014b3a8b None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:11.235267 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 212/416] 10.222.0.93 () {58 vars in 1023 bytes} [Tue Jul 26 14:38:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 14:38:11.237885 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ad0b30-a856-48d0-ad90-ee68ef7d49b6 None None] REQUEST_METHOD: `POST` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:11.238797 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ad0b30-a856-48d0-ad90-ee68ef7d49b6 None None] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:11.239497 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ad0b30-a856-48d0-ad90-ee68ef7d49b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:11.270914 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.auth.core [None req-f0ad0b30-a856-48d0-ad90-ee68ef7d49b6 None None] MFA Rules not processed for user `e5ef88cc058f425b882bcb87a1e1e75c`. Rule list: `[]` (Enabled: `True`). {{(pid=87056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:38:11.274186 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.fernet_utils [None req-f0ad0b30-a856-48d0-ad90-ee68ef7d49b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:38:11.299409 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a68fc24-7b71-4bf6-9e99-fedf38044f16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:11.300543 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a68fc24-7b71-4bf6-9e99-fedf38044f16 None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:11.300943 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a68fc24-7b71-4bf6-9e99-fedf38044f16 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:11.301394 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a68fc24-7b71-4bf6-9e99-fedf38044f16 None admin] PATH_INFO: `/v3/projects/223cfb51fde24882a520cb183c0f36f8` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:11.303507 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a68fc24-7b71-4bf6-9e99-fedf38044f16 None admin] RBAC: Authorizing `identity:get_project(project_id=223cfb51fde24882a520cb183c0f36f8)` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:38:11.305776 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a68fc24-7b71-4bf6-9e99-fedf38044f16 None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:38:11.309811 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 205/417] 10.222.0.93 () {56 vars in 1186 bytes} [Tue Jul 26 14:38:11 2022] GET /identity/v3/projects/223cfb51fde24882a520cb183c0f36f8 => generated 302 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:38:11.311084 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a68fc24-7b71-4bf6-9e99-fedf38044f16 None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:11.409145 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:38:11.416612 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 213/418] 10.222.0.93 () {58 vars in 1023 bytes} [Tue Jul 26 14:38:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 14:38:11.422284 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ad0b30-a856-48d0-ad90-ee68ef7d49b6 None None] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:11.422520 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:38:11.550063 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a68fc24-7b71-4bf6-9e99-fedf38044f16 None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:11.599649 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ad0b30-a856-48d0-ad90-ee68ef7d49b6 None None] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:11.640173 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea2fa7c-ecec-4e13-a7f0-cdc657893f46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:11.641305 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea2fa7c-ecec-4e13-a7f0-cdc657893f46 None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:11.641808 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea2fa7c-ecec-4e13-a7f0-cdc657893f46 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:11.642330 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea2fa7c-ecec-4e13-a7f0-cdc657893f46 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:11.676036 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea2fa7c-ecec-4e13-a7f0-cdc657893f46 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 14:38:11.683680 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0aecb56-4165-475b-8742-786bdf16e582 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:11.685895 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aecb56-4165-475b-8742-786bdf16e582 None admin] REQUEST_METHOD: `PUT` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:11.686702 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aecb56-4165-475b-8742-786bdf16e582 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:11.687455 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aecb56-4165-475b-8742-786bdf16e582 None admin] PATH_INFO: `/v3/projects/223cfb51fde24882a520cb183c0f36f8/groups/2c517fc77ff14f6680fe39decfb3c543/roles/8b8a4a451dc84c17bba824b2ff9cc4fe` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:11.691707 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0aecb56-4165-475b-8742-786bdf16e582 None admin] RBAC: Authorizing `identity:create_grant(project_id=223cfb51fde24882a520cb183c0f36f8, group_id=2c517fc77ff14f6680fe39decfb3c543, role_id=8b8a4a451dc84c17bba824b2ff9cc4fe)` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:38:11.692760 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application [None req-8ea2fa7c-ecec-4e13-a7f0-cdc657893f46 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 14:38:11.692760 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:38:11.692760 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:38:11.692760 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:38:11.692760 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:38:11.692760 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:38:11.692760 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:38:11.692760 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:38:11.692760 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:38:11.692760 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:38:11.692760 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:38:11.692760 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:38:11.692760 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 14:38:11.692760 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 14:38:11.692760 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 14:38:11.692760 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 14:38:11.694365 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 14:38:11.694365 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 14:38:11.694365 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 14:38:11.694365 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 14:38:11.694365 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:38:11.694365 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:38:11.694365 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:38:11.694365 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:38:11.694365 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:38:11.694365 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:38:11.694365 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:38:11.694365 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application with Lock( Jul 26 14:38:11.694365 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:38:11.694365 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:38:11.694365 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:38:11.694365 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:38:11.696417 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:38:11.696417 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:38:11.696417 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:38:11.696417 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:38:11.696417 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 14:38:11.696417 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 14:38:11.696417 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 14:38:11.696417 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 14:38:11.696417 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 14:38:11.696417 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 14:38:11.696417 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 14:38:11.696417 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Jul 26 14:38:11.696417 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 206/419] 10.222.0.93 () {56 vars in 1114 bytes} [Tue Jul 26 14:38:11 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 384 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:38:11.696417 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea2fa7c-ecec-4e13-a7f0-cdc657893f46 None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:11.702546 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0aecb56-4165-475b-8742-786bdf16e582 None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:38:11.840183 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 214/420] 10.222.0.93 () {58 vars in 1442 bytes} [Tue Jul 26 14:38:11 2022] PUT /identity/v3/projects/223cfb51fde24882a520cb183c0f36f8/groups/2c517fc77ff14f6680fe39decfb3c543/roles/8b8a4a451dc84c17bba824b2ff9cc4fe => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 14:38:11.842391 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0aecb56-4165-475b-8742-786bdf16e582 None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:11.874295 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea2fa7c-ecec-4e13-a7f0-cdc657893f46 None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:11.891399 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:38:11.962544 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6433aca3-5db4-4e34-8ec0-5fbfffd174a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:11.967201 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6433aca3-5db4-4e34-8ec0-5fbfffd174a7 None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:11.967691 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6433aca3-5db4-4e34-8ec0-5fbfffd174a7 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:11.968170 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6433aca3-5db4-4e34-8ec0-5fbfffd174a7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:12.021771 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6433aca3-5db4-4e34-8ec0-5fbfffd174a7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 14:38:12.042890 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application [None req-6433aca3-5db4-4e34-8ec0-5fbfffd174a7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 26 14:38:12.042890 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:38:12.042890 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:38:12.042890 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:38:12.042890 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:38:12.042890 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:38:12.042890 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:38:12.042890 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:38:12.042890 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:38:12.042890 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:38:12.042890 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:38:12.042890 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:38:12.042890 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 14:38:12.042890 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 14:38:12.042890 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 14:38:12.042890 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 14:38:12.044715 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 14:38:12.044715 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 14:38:12.044715 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 14:38:12.044715 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 14:38:12.044715 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:38:12.044715 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:38:12.044715 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:38:12.044715 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:38:12.044715 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:38:12.044715 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:38:12.044715 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:38:12.044715 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application with Lock( Jul 26 14:38:12.044715 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:38:12.044715 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:38:12.044715 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:38:12.044715 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:38:12.046338 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:38:12.046338 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:38:12.046338 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:38:12.046338 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:38:12.046338 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 14:38:12.046338 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 14:38:12.046338 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 14:38:12.046338 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 14:38:12.046338 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 14:38:12.046338 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 14:38:12.046338 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 26 14:38:12.046338 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Jul 26 14:38:12.052033 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 207/421] 10.222.0.93 () {56 vars in 1099 bytes} [Tue Jul 26 14:38:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 357 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:38:12.060126 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6433aca3-5db4-4e34-8ec0-5fbfffd174a7 None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:12.090745 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:38:12.165702 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0aecb56-4165-475b-8742-786bdf16e582 None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:12.222523 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acfe0d8-3372-4826-a446-e4a43f4fbee1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:12.223751 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acfe0d8-3372-4826-a446-e4a43f4fbee1 None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:12.224263 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acfe0d8-3372-4826-a446-e4a43f4fbee1 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:12.224753 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acfe0d8-3372-4826-a446-e4a43f4fbee1 None admin] PATH_INFO: `/v3/roles` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:12.227244 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acfe0d8-3372-4826-a446-e4a43f4fbee1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:38:12.227434 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acfe0d8-3372-4826-a446-e4a43f4fbee1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:38:12.230050 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acfe0d8-3372-4826-a446-e4a43f4fbee1 None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:38:12.247079 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 215/422] 10.222.0.93 () {56 vars in 1111 bytes} [Tue Jul 26 14:38:11 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 406 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:38:12.256472 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acfe0d8-3372-4826-a446-e4a43f4fbee1 None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:12.265953 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6433aca3-5db4-4e34-8ec0-5fbfffd174a7 None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:12.380342 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bfb20c-b9d6-4d5a-8309-bfed2f1cee77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:12.382906 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bfb20c-b9d6-4d5a-8309-bfed2f1cee77 None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:12.382906 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bfb20c-b9d6-4d5a-8309-bfed2f1cee77 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:12.382906 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bfb20c-b9d6-4d5a-8309-bfed2f1cee77 None admin] PATH_INFO: `/v3/roles` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:12.384304 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bfb20c-b9d6-4d5a-8309-bfed2f1cee77 None admin] RBAC: Adding query filter params (name=member) {{(pid=87055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:38:12.384850 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bfb20c-b9d6-4d5a-8309-bfed2f1cee77 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:38:12.393975 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bfb20c-b9d6-4d5a-8309-bfed2f1cee77 None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:38:12.418924 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 208/423] 10.222.0.93 () {56 vars in 1101 bytes} [Tue Jul 26 14:38:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 360 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:38:12.427614 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bfb20c-b9d6-4d5a-8309-bfed2f1cee77 None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:12.470514 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acfe0d8-3372-4826-a446-e4a43f4fbee1 None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:12.499990 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:38:12.513148 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c1c8e6-f9ed-4d94-b351-395e2c2013c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:12.514212 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c1c8e6-f9ed-4d94-b351-395e2c2013c1 None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:12.516158 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c1c8e6-f9ed-4d94-b351-395e2c2013c1 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:12.516748 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c1c8e6-f9ed-4d94-b351-395e2c2013c1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:12.580726 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:38:12.603934 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c1c8e6-f9ed-4d94-b351-395e2c2013c1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:38:12.605868 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c1c8e6-f9ed-4d94-b351-395e2c2013c1 None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:38:12.712036 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bfb20c-b9d6-4d5a-8309-bfed2f1cee77 None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:12.755127 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6a5032-0ff8-4d9f-8dee-46260c3008dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:12.756132 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6a5032-0ff8-4d9f-8dee-46260c3008dd None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:12.756549 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6a5032-0ff8-4d9f-8dee-46260c3008dd None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:12.756955 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6a5032-0ff8-4d9f-8dee-46260c3008dd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:12.766101 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 216/424] 10.222.0.93 () {58 vars in 1282 bytes} [Tue Jul 26 14:38:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 511 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 14:38:12.776978 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c1c8e6-f9ed-4d94-b351-395e2c2013c1 None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:12.814980 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:38:12.938758 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c1c8e6-f9ed-4d94-b351-395e2c2013c1 None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:12.961210 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6a5032-0ff8-4d9f-8dee-46260c3008dd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:38:12.963025 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6a5032-0ff8-4d9f-8dee-46260c3008dd None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:38:13.022682 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d473c7-d362-4e96-8773-0a2b6357960a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:13.024519 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d473c7-d362-4e96-8773-0a2b6357960a None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:13.024968 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d473c7-d362-4e96-8773-0a2b6357960a None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:13.025393 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d473c7-d362-4e96-8773-0a2b6357960a None admin] PATH_INFO: `/v3/projects/798795388b0c46a3a4ae48ca79f5c6ce` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:13.027098 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d473c7-d362-4e96-8773-0a2b6357960a None admin] RBAC: Authorizing `identity:get_project(project_id=798795388b0c46a3a4ae48ca79f5c6ce)` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:38:13.028765 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d473c7-d362-4e96-8773-0a2b6357960a None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:38:13.029102 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:38:13.031220 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 217/425] 10.222.0.93 () {56 vars in 1186 bytes} [Tue Jul 26 14:38:12 2022] GET /identity/v3/projects/798795388b0c46a3a4ae48ca79f5c6ce => generated 298 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:38:13.039234 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d473c7-d362-4e96-8773-0a2b6357960a None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:13.205341 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 209/426] 10.222.0.93 () {58 vars in 1282 bytes} [Tue Jul 26 14:38:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 779 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 14:38:13.210213 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6a5032-0ff8-4d9f-8dee-46260c3008dd None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:13.243122 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:38:13.251407 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d473c7-d362-4e96-8773-0a2b6357960a None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:13.298876 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a85f8d7-9f30-425e-9c5a-41fb12a262d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:13.299826 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a85f8d7-9f30-425e-9c5a-41fb12a262d9 None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:13.300268 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a85f8d7-9f30-425e-9c5a-41fb12a262d9 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:13.300688 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a85f8d7-9f30-425e-9c5a-41fb12a262d9 None admin] PATH_INFO: `/v3/groups/2c517fc77ff14f6680fe39decfb3c543` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:13.303879 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a85f8d7-9f30-425e-9c5a-41fb12a262d9 None admin] RBAC: Authorizing `identity:get_group(group_id=2c517fc77ff14f6680fe39decfb3c543)` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:38:13.306360 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a85f8d7-9f30-425e-9c5a-41fb12a262d9 None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:38:13.310486 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 218/427] 10.222.0.93 () {56 vars in 1180 bytes} [Tue Jul 26 14:38:13 2022] GET /identity/v3/groups/2c517fc77ff14f6680fe39decfb3c543 => generated 226 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:38:13.323351 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a85f8d7-9f30-425e-9c5a-41fb12a262d9 None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:13.442171 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a85f8d7-9f30-425e-9c5a-41fb12a262d9 None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:13.484879 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036c00f1-b2f9-453a-8fda-c6682088a9d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:13.485956 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036c00f1-b2f9-453a-8fda-c6682088a9d4 None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:13.486470 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036c00f1-b2f9-453a-8fda-c6682088a9d4 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:13.487112 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036c00f1-b2f9-453a-8fda-c6682088a9d4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:13.488764 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036c00f1-b2f9-453a-8fda-c6682088a9d4 None admin] RBAC: Adding query filter params (group.id=2c517fc77ff14f6680fe39decfb3c543, role.id=ef1a806f8d774452a6536b57a4670ceb, scope.project.id=798795388b0c46a3a4ae48ca79f5c6ce) {{(pid=87056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:38:13.489565 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036c00f1-b2f9-453a-8fda-c6682088a9d4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:38:13.492650 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036c00f1-b2f9-453a-8fda-c6682088a9d4 None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:38:13.504847 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 219/428] 10.222.0.93 () {56 vars in 1376 bytes} [Tue Jul 26 14:38:13 2022] GET /identity/v3/role_assignments?group.id=2c517fc77ff14f6680fe39decfb3c543&scope.project.id=798795388b0c46a3a4ae48ca79f5c6ce&role.id=ef1a806f8d774452a6536b57a4670ceb => generated 611 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:38:13.555410 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6971eb3a-1b4f-4d56-a3df-bb023d63dc01 None None] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:13.555988 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6971eb3a-1b4f-4d56-a3df-bb023d63dc01 None None] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:13.556375 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6971eb3a-1b4f-4d56-a3df-bb023d63dc01 None None] PATH_INFO: `/` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:13.558376 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 220/429] 10.222.0.93 () {54 vars in 926 bytes} [Tue Jul 26 14:38:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 14:38:13.564469 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc397ba-830a-48c2-8c14-e6df3eda06c3 None None] REQUEST_METHOD: `POST` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:13.564892 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc397ba-830a-48c2-8c14-e6df3eda06c3 None None] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:13.565295 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc397ba-830a-48c2-8c14-e6df3eda06c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:13.578685 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6a5032-0ff8-4d9f-8dee-46260c3008dd None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:13.621252 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.auth.core [None req-fbc397ba-830a-48c2-8c14-e6df3eda06c3 None None] MFA Rules not processed for user `e5ef88cc058f425b882bcb87a1e1e75c`. Rule list: `[]` (Enabled: `True`). {{(pid=87056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:38:13.623453 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.fernet_utils [None req-fbc397ba-830a-48c2-8c14-e6df3eda06c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:38:13.670673 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:38:13.684972 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00e069a-9230-4229-ab30-a0c8a21b7e31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:13.686075 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00e069a-9230-4229-ab30-a0c8a21b7e31 None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:13.690838 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00e069a-9230-4229-ab30-a0c8a21b7e31 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:13.690838 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00e069a-9230-4229-ab30-a0c8a21b7e31 None admin] PATH_INFO: `/v3/projects/798795388b0c46a3a4ae48ca79f5c6ce` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:13.693833 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00e069a-9230-4229-ab30-a0c8a21b7e31 None admin] RBAC: Authorizing `identity:get_project(project_id=798795388b0c46a3a4ae48ca79f5c6ce)` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:38:13.696701 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00e069a-9230-4229-ab30-a0c8a21b7e31 None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:38:13.705336 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:38:13.713471 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 210/430] 10.222.0.93 () {56 vars in 1186 bytes} [Tue Jul 26 14:38:13 2022] GET /identity/v3/projects/798795388b0c46a3a4ae48ca79f5c6ce => generated 298 bytes in 503 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:38:13.715120 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00e069a-9230-4229-ab30-a0c8a21b7e31 None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:13.818372 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 221/431] 10.222.0.93 () {58 vars in 1023 bytes} [Tue Jul 26 14:38:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 14:38:13.840743 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc397ba-830a-48c2-8c14-e6df3eda06c3 None None] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:13.932902 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00e069a-9230-4229-ab30-a0c8a21b7e31 None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:13.977457 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72318ff8-73e8-4257-a091-550d41869ee2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:13.978569 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72318ff8-73e8-4257-a091-550d41869ee2 None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:13.979055 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72318ff8-73e8-4257-a091-550d41869ee2 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:13.979535 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72318ff8-73e8-4257-a091-550d41869ee2 None admin] PATH_INFO: `/v3/groups/2c517fc77ff14f6680fe39decfb3c543` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:13.981129 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72318ff8-73e8-4257-a091-550d41869ee2 None admin] RBAC: Authorizing `identity:get_group(group_id=2c517fc77ff14f6680fe39decfb3c543)` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:38:13.983041 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72318ff8-73e8-4257-a091-550d41869ee2 None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:38:13.985438 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 211/432] 10.222.0.93 () {56 vars in 1180 bytes} [Tue Jul 26 14:38:13 2022] GET /identity/v3/groups/2c517fc77ff14f6680fe39decfb3c543 => generated 226 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:38:13.992621 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72318ff8-73e8-4257-a091-550d41869ee2 None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:14.041495 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc397ba-830a-48c2-8c14-e6df3eda06c3 None None] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:14.079277 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:38:14.094852 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647255fe-7efb-4303-9096-b0694ab491de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:14.095527 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647255fe-7efb-4303-9096-b0694ab491de None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:14.095814 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647255fe-7efb-4303-9096-b0694ab491de None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:14.096091 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647255fe-7efb-4303-9096-b0694ab491de None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:14.109972 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647255fe-7efb-4303-9096-b0694ab491de None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 14:38:14.115291 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application [None req-647255fe-7efb-4303-9096-b0694ab491de None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 14:38:14.115291 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:38:14.115291 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:38:14.115291 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:38:14.115291 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:38:14.115291 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:38:14.115291 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:38:14.115291 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:38:14.115291 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:38:14.115291 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:38:14.115291 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:38:14.115291 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:38:14.115291 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 14:38:14.115291 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 14:38:14.115291 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 14:38:14.115291 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 14:38:14.116974 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 14:38:14.116974 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 14:38:14.116974 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 14:38:14.116974 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 14:38:14.116974 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:38:14.116974 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:38:14.116974 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:38:14.116974 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:38:14.116974 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:38:14.116974 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:38:14.116974 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:38:14.116974 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application with Lock( Jul 26 14:38:14.116974 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:38:14.116974 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:38:14.116974 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:38:14.116974 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:38:14.124930 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:38:14.124930 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:38:14.124930 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:38:14.124930 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:38:14.124930 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 14:38:14.124930 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 14:38:14.124930 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 14:38:14.124930 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 14:38:14.124930 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 14:38:14.124930 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 14:38:14.124930 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 14:38:14.124930 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Jul 26 14:38:14.124930 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 222/433] 10.222.0.93 () {56 vars in 1096 bytes} [Tue Jul 26 14:38:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 14:38:14.124930 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d0b5d2-3573-4fac-a825-5e6a0dde8f7c None None] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:14.125723 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d0b5d2-3573-4fac-a825-5e6a0dde8f7c None None] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:14.125723 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d0b5d2-3573-4fac-a825-5e6a0dde8f7c None None] PATH_INFO: `/` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:14.125723 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 223/434] 10.222.0.93 () {54 vars in 926 bytes} [Tue Jul 26 14:38:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:38:14.125723 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d0b5d2-3573-4fac-a825-5e6a0dde8f7c None None] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:14.137519 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72318ff8-73e8-4257-a091-550d41869ee2 None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:14.149136 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:38:14.183169 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be214c0c-6e5e-41d2-914b-4415bfd2c393 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:14.184160 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be214c0c-6e5e-41d2-914b-4415bfd2c393 None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:14.184530 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be214c0c-6e5e-41d2-914b-4415bfd2c393 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:14.184906 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be214c0c-6e5e-41d2-914b-4415bfd2c393 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:14.185908 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be214c0c-6e5e-41d2-914b-4415bfd2c393 None admin] RBAC: Adding query filter params (group.id=2c517fc77ff14f6680fe39decfb3c543, role.id=8b8a4a451dc84c17bba824b2ff9cc4fe, scope.project.id=798795388b0c46a3a4ae48ca79f5c6ce) {{(pid=87055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:38:14.186314 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be214c0c-6e5e-41d2-914b-4415bfd2c393 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:38:14.188258 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be214c0c-6e5e-41d2-914b-4415bfd2c393 None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:38:14.197194 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 212/435] 10.222.0.93 () {56 vars in 1376 bytes} [Tue Jul 26 14:38:13 2022] GET /identity/v3/role_assignments?group.id=2c517fc77ff14f6680fe39decfb3c543&scope.project.id=798795388b0c46a3a4ae48ca79f5c6ce&role.id=8b8a4a451dc84c17bba824b2ff9cc4fe => generated 611 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:38:14.198970 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c44233-aa99-4445-af1e-27e2bbff1b30 None None] REQUEST_METHOD: `POST` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:14.199260 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c44233-aa99-4445-af1e-27e2bbff1b30 None None] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:14.199544 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c44233-aa99-4445-af1e-27e2bbff1b30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:14.228269 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.auth.core [None req-b1c44233-aa99-4445-af1e-27e2bbff1b30 None None] MFA Rules not processed for user `e5ef88cc058f425b882bcb87a1e1e75c`. Rule list: `[]` (Enabled: `True`). {{(pid=87055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:38:14.230476 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.fernet_utils [None req-b1c44233-aa99-4445-af1e-27e2bbff1b30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:38:14.295624 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d0b5d2-3573-4fac-a825-5e6a0dde8f7c None None] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:14.338380 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 213/436] 10.222.0.93 () {58 vars in 1023 bytes} [Tue Jul 26 14:38:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 14:38:14.362625 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771dee49-7c86-447c-aa32-c0ae34e596b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:14.363972 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771dee49-7c86-447c-aa32-c0ae34e596b3 None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:14.364715 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771dee49-7c86-447c-aa32-c0ae34e596b3 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:14.365401 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771dee49-7c86-447c-aa32-c0ae34e596b3 None admin] PATH_INFO: `/v3/roles` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:14.367552 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771dee49-7c86-447c-aa32-c0ae34e596b3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:38:14.368466 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771dee49-7c86-447c-aa32-c0ae34e596b3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:38:14.371090 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c44233-aa99-4445-af1e-27e2bbff1b30 None None] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:14.371806 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771dee49-7c86-447c-aa32-c0ae34e596b3 None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:38:14.383280 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 224/437] 10.222.0.93 () {56 vars in 1099 bytes} [Tue Jul 26 14:38:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:38:14.396163 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771dee49-7c86-447c-aa32-c0ae34e596b3 None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:14.509060 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:38:14.546853 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:38:14.573879 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771dee49-7c86-447c-aa32-c0ae34e596b3 None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:14.589024 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c44233-aa99-4445-af1e-27e2bbff1b30 None None] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:14.650670 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16218d08-6565-4e49-8b6c-304dc0cd78fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:14.651518 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16218d08-6565-4e49-8b6c-304dc0cd78fc None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:14.651954 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16218d08-6565-4e49-8b6c-304dc0cd78fc None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:14.652360 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16218d08-6565-4e49-8b6c-304dc0cd78fc None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:14.659891 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b291e992-21bb-4b1d-b0a4-da369ca66ce8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:14.660996 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b291e992-21bb-4b1d-b0a4-da369ca66ce8 None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:14.661409 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b291e992-21bb-4b1d-b0a4-da369ca66ce8 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:14.661829 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b291e992-21bb-4b1d-b0a4-da369ca66ce8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:14.676695 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16218d08-6565-4e49-8b6c-304dc0cd78fc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 14:38:14.680245 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application [None req-16218d08-6565-4e49-8b6c-304dc0cd78fc None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 14:38:14.680245 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:38:14.680245 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:38:14.680245 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:38:14.680245 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:38:14.680245 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:38:14.680245 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:38:14.680245 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:38:14.680245 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:38:14.680245 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:38:14.680245 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:38:14.680245 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:38:14.680245 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 14:38:14.680245 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 14:38:14.680245 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 14:38:14.680245 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 14:38:14.682189 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 14:38:14.682189 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 14:38:14.682189 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 14:38:14.682189 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 14:38:14.682189 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:38:14.682189 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:38:14.682189 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:38:14.682189 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:38:14.682189 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:38:14.682189 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:38:14.682189 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:38:14.682189 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application with Lock( Jul 26 14:38:14.682189 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:38:14.682189 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:38:14.682189 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:38:14.682189 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:38:14.683773 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:38:14.683773 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:38:14.683773 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:38:14.683773 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:38:14.683773 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 14:38:14.683773 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 14:38:14.683773 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 14:38:14.683773 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 14:38:14.683773 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 14:38:14.683773 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 14:38:14.683773 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 14:38:14.683773 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Jul 26 14:38:14.690321 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 214/438] 10.222.0.93 () {56 vars in 1114 bytes} [Tue Jul 26 14:38:14 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:38:14.691858 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16218d08-6565-4e49-8b6c-304dc0cd78fc None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:14.799553 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b291e992-21bb-4b1d-b0a4-da369ca66ce8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:38:14.802172 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b291e992-21bb-4b1d-b0a4-da369ca66ce8 None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:38:14.856865 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16218d08-6565-4e49-8b6c-304dc0cd78fc None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:14.893782 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:38:14.911648 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2cade3-6b9c-4d76-849c-14849bad517d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:14.912978 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2cade3-6b9c-4d76-849c-14849bad517d None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:14.913648 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2cade3-6b9c-4d76-849c-14849bad517d None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:14.914117 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2cade3-6b9c-4d76-849c-14849bad517d None admin] PATH_INFO: `/v3/roles` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:14.915521 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2cade3-6b9c-4d76-849c-14849bad517d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:38:14.916047 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2cade3-6b9c-4d76-849c-14849bad517d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:38:14.918620 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2cade3-6b9c-4d76-849c-14849bad517d None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:38:14.937265 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 215/439] 10.222.0.93 () {56 vars in 1111 bytes} [Tue Jul 26 14:38:14 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:38:14.939780 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2cade3-6b9c-4d76-849c-14849bad517d None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:14.960478 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:38:15.011420 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 225/440] 10.222.0.93 () {58 vars in 1282 bytes} [Tue Jul 26 14:38:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 616 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 14:38:15.020304 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b291e992-21bb-4b1d-b0a4-da369ca66ce8 None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:15.088090 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2cade3-6b9c-4d76-849c-14849bad517d None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:15.140021 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5aa5da-7906-4d15-af3b-3caec1a97ea2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:15.140732 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5aa5da-7906-4d15-af3b-3caec1a97ea2 None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:15.141109 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5aa5da-7906-4d15-af3b-3caec1a97ea2 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:15.141470 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5aa5da-7906-4d15-af3b-3caec1a97ea2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:15.191709 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b291e992-21bb-4b1d-b0a4-da369ca66ce8 None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:15.201403 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:38:15.227122 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5aa5da-7906-4d15-af3b-3caec1a97ea2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:38:15.228834 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5aa5da-7906-4d15-af3b-3caec1a97ea2 None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:38:15.248274 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d597e1-eef1-431d-95e8-6bfdc560986b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:15.249304 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d597e1-eef1-431d-95e8-6bfdc560986b None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:15.249674 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d597e1-eef1-431d-95e8-6bfdc560986b None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:15.250129 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d597e1-eef1-431d-95e8-6bfdc560986b None admin] PATH_INFO: `/v3/projects/f499667f2a194620a3504e461bf3cc25` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:15.252200 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d597e1-eef1-431d-95e8-6bfdc560986b None admin] RBAC: Authorizing `identity:get_project(project_id=f499667f2a194620a3504e461bf3cc25)` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:38:15.254997 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d597e1-eef1-431d-95e8-6bfdc560986b None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:38:15.257598 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 226/441] 10.222.0.93 () {56 vars in 1186 bytes} [Tue Jul 26 14:38:15 2022] GET /identity/v3/projects/f499667f2a194620a3504e461bf3cc25 => generated 344 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:38:15.259969 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f4ede9-0d4b-42ee-9501-836a68897cfe None None] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:15.260451 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f4ede9-0d4b-42ee-9501-836a68897cfe None None] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:15.260944 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f4ede9-0d4b-42ee-9501-836a68897cfe None None] PATH_INFO: `/` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:15.263822 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 227/442] 10.222.0.93 () {54 vars in 926 bytes} [Tue Jul 26 14:38:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:38:15.267124 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f4ede9-0d4b-42ee-9501-836a68897cfe None None] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:15.345490 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:38:15.377094 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 216/443] 10.222.0.93 () {58 vars in 1282 bytes} [Tue Jul 26 14:38:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 26 14:38:15.378597 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dfb97b-a815-4106-8cff-aa7de45fe5b6 None None] REQUEST_METHOD: `POST` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:15.379030 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dfb97b-a815-4106-8cff-aa7de45fe5b6 None None] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:15.379397 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dfb97b-a815-4106-8cff-aa7de45fe5b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:15.407208 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.auth.core [None req-87dfb97b-a815-4106-8cff-aa7de45fe5b6 None None] MFA Rules not processed for user `e5ef88cc058f425b882bcb87a1e1e75c`. Rule list: `[]` (Enabled: `True`). {{(pid=87055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:38:15.408913 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.fernet_utils [None req-87dfb97b-a815-4106-8cff-aa7de45fe5b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:38:15.434745 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f4ede9-0d4b-42ee-9501-836a68897cfe None None] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:15.482467 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2876a43-4435-4163-b363-0546f3bd54ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:15.483204 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2876a43-4435-4163-b363-0546f3bd54ae None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:15.483553 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2876a43-4435-4163-b363-0546f3bd54ae None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:15.483920 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2876a43-4435-4163-b363-0546f3bd54ae None admin] PATH_INFO: `/v3/groups/ec734c7f48104755b00a395ee63f6634` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:15.485731 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2876a43-4435-4163-b363-0546f3bd54ae None admin] RBAC: Authorizing `identity:get_group(group_id=ec734c7f48104755b00a395ee63f6634)` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:38:15.487845 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2876a43-4435-4163-b363-0546f3bd54ae None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:38:15.489912 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 228/444] 10.222.0.93 () {56 vars in 1180 bytes} [Tue Jul 26 14:38:15 2022] GET /identity/v3/groups/ec734c7f48104755b00a395ee63f6634 => generated 229 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:38:15.491061 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2876a43-4435-4163-b363-0546f3bd54ae None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:15.506680 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 217/445] 10.222.0.93 () {58 vars in 1023 bytes} [Tue Jul 26 14:38:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 14:38:15.508525 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dfb97b-a815-4106-8cff-aa7de45fe5b6 None None] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:15.528372 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:38:15.645697 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dfb97b-a815-4106-8cff-aa7de45fe5b6 None None] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:15.659942 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2876a43-4435-4163-b363-0546f3bd54ae None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:15.676932 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:38:15.699331 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa85d80-479e-443b-a170-272ec2ebadb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:15.700322 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa85d80-479e-443b-a170-272ec2ebadb3 None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:15.700769 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa85d80-479e-443b-a170-272ec2ebadb3 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:15.701200 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa85d80-479e-443b-a170-272ec2ebadb3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:15.702641 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa85d80-479e-443b-a170-272ec2ebadb3 None admin] RBAC: Adding query filter params (group.id=ec734c7f48104755b00a395ee63f6634, role.id=94e105ff8ee4486abd501415cc05ba38, scope.project.id=f499667f2a194620a3504e461bf3cc25) {{(pid=87055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:38:15.703056 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa85d80-479e-443b-a170-272ec2ebadb3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:38:15.705481 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa85d80-479e-443b-a170-272ec2ebadb3 None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:38:15.710447 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6d6897-69aa-41ba-a4a0-45c9894f139b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:15.711278 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6d6897-69aa-41ba-a4a0-45c9894f139b None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:15.711678 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6d6897-69aa-41ba-a4a0-45c9894f139b None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:15.712121 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6d6897-69aa-41ba-a4a0-45c9894f139b None admin] PATH_INFO: `/v3/projects/223cfb51fde24882a520cb183c0f36f8` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:15.713614 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6d6897-69aa-41ba-a4a0-45c9894f139b None admin] RBAC: Authorizing `identity:get_project(project_id=223cfb51fde24882a520cb183c0f36f8)` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:38:15.715077 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 218/446] 10.222.0.93 () {56 vars in 1376 bytes} [Tue Jul 26 14:38:15 2022] GET /identity/v3/role_assignments?group.id=ec734c7f48104755b00a395ee63f6634&scope.project.id=f499667f2a194620a3504e461bf3cc25&role.id=94e105ff8ee4486abd501415cc05ba38 => generated 611 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:38:15.715401 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6d6897-69aa-41ba-a4a0-45c9894f139b None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:38:15.716807 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa85d80-479e-443b-a170-272ec2ebadb3 None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:15.723273 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 229/447] 10.222.0.93 () {56 vars in 1186 bytes} [Tue Jul 26 14:38:15 2022] GET /identity/v3/projects/223cfb51fde24882a520cb183c0f36f8 => generated 302 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:38:15.725384 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6d6897-69aa-41ba-a4a0-45c9894f139b None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:15.860426 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:38:15.896299 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6d6897-69aa-41ba-a4a0-45c9894f139b None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:15.903875 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa85d80-479e-443b-a170-272ec2ebadb3 None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:15.952949 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991b7948-5cec-411a-bc23-a6c88b9ad684 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:15.953876 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991b7948-5cec-411a-bc23-a6c88b9ad684 None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:15.954349 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991b7948-5cec-411a-bc23-a6c88b9ad684 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:15.955473 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991b7948-5cec-411a-bc23-a6c88b9ad684 None admin] PATH_INFO: `/v3/groups/2c517fc77ff14f6680fe39decfb3c543` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:15.957589 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991b7948-5cec-411a-bc23-a6c88b9ad684 None admin] RBAC: Authorizing `identity:get_group(group_id=2c517fc77ff14f6680fe39decfb3c543)` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:38:15.959651 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991b7948-5cec-411a-bc23-a6c88b9ad684 None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:38:15.963426 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 230/448] 10.222.0.93 () {56 vars in 1180 bytes} [Tue Jul 26 14:38:15 2022] GET /identity/v3/groups/2c517fc77ff14f6680fe39decfb3c543 => generated 226 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:38:15.964276 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ec60ff-638d-4ac2-a28b-4732f00d35a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:15.964276 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ec60ff-638d-4ac2-a28b-4732f00d35a2 None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:15.964276 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ec60ff-638d-4ac2-a28b-4732f00d35a2 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:15.964276 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ec60ff-638d-4ac2-a28b-4732f00d35a2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:15.972189 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991b7948-5cec-411a-bc23-a6c88b9ad684 None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:15.987781 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ec60ff-638d-4ac2-a28b-4732f00d35a2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 14:38:15.994401 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application [None req-42ec60ff-638d-4ac2-a28b-4732f00d35a2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 26 14:38:15.994401 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:38:15.994401 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:38:15.994401 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:38:15.994401 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:38:15.994401 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:38:15.994401 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:38:15.994401 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:38:15.994401 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:38:15.994401 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:38:15.994401 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:38:15.994401 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:38:15.994401 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 14:38:15.994401 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 14:38:15.994401 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 14:38:15.994401 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 14:38:16.004402 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 14:38:16.004402 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 14:38:16.004402 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 14:38:16.004402 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 14:38:16.004402 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:38:16.004402 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:38:16.004402 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:38:16.004402 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:38:16.004402 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:38:16.004402 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:38:16.004402 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:38:16.004402 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application with Lock( Jul 26 14:38:16.004402 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:38:16.004402 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:38:16.004402 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:38:16.004402 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:38:16.005938 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:38:16.005938 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:38:16.005938 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:38:16.005938 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:38:16.005938 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 14:38:16.005938 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 14:38:16.005938 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 14:38:16.005938 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 14:38:16.005938 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 14:38:16.005938 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 14:38:16.005938 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 26 14:38:16.005938 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Jul 26 14:38:16.005938 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 219/449] 10.222.0.93 () {56 vars in 1099 bytes} [Tue Jul 26 14:38:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:38:16.005938 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ec60ff-638d-4ac2-a28b-4732f00d35a2 None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:16.049575 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:38:16.127682 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991b7948-5cec-411a-bc23-a6c88b9ad684 None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:16.135594 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ec60ff-638d-4ac2-a28b-4732f00d35a2 None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:16.173893 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4fd211-868a-483d-87ff-b1a451a9a992 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:16.174460 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4d5292-6e43-46fc-8036-053f82323e1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:16.174867 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4fd211-868a-483d-87ff-b1a451a9a992 None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:16.175269 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4fd211-868a-483d-87ff-b1a451a9a992 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:16.175421 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4d5292-6e43-46fc-8036-053f82323e1a None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:16.175728 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4fd211-868a-483d-87ff-b1a451a9a992 None admin] PATH_INFO: `/v3/roles` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:16.175897 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4d5292-6e43-46fc-8036-053f82323e1a None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:16.176289 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4d5292-6e43-46fc-8036-053f82323e1a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:16.176782 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4fd211-868a-483d-87ff-b1a451a9a992 None admin] RBAC: Adding query filter params (name=member) {{(pid=87055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:38:16.177210 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4fd211-868a-483d-87ff-b1a451a9a992 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:38:16.177807 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4d5292-6e43-46fc-8036-053f82323e1a None admin] RBAC: Adding query filter params (group.id=2c517fc77ff14f6680fe39decfb3c543, role.id=ef1a806f8d774452a6536b57a4670ceb, scope.project.id=223cfb51fde24882a520cb183c0f36f8) {{(pid=87056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:38:16.178331 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4d5292-6e43-46fc-8036-053f82323e1a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:38:16.179797 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4fd211-868a-483d-87ff-b1a451a9a992 None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:38:16.181496 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4d5292-6e43-46fc-8036-053f82323e1a None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:38:16.182444 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:38:16.190393 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 220/450] 10.222.0.93 () {56 vars in 1101 bytes} [Tue Jul 26 14:38:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:38:16.190655 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 231/451] 10.222.0.93 () {56 vars in 1376 bytes} [Tue Jul 26 14:38:15 2022] GET /identity/v3/role_assignments?group.id=2c517fc77ff14f6680fe39decfb3c543&scope.project.id=223cfb51fde24882a520cb183c0f36f8&role.id=ef1a806f8d774452a6536b57a4670ceb => generated 611 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:38:16.198705 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4fd211-868a-483d-87ff-b1a451a9a992 None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:16.321943 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4fd211-868a-483d-87ff-b1a451a9a992 None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:16.361582 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18e77ae-4f1a-4438-bb5c-34e7a310056a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:16.362353 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18e77ae-4f1a-4438-bb5c-34e7a310056a None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:16.362638 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18e77ae-4f1a-4438-bb5c-34e7a310056a None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:16.362925 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18e77ae-4f1a-4438-bb5c-34e7a310056a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:16.439356 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:38:16.443137 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18e77ae-4f1a-4438-bb5c-34e7a310056a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:38:16.444756 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18e77ae-4f1a-4438-bb5c-34e7a310056a None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:38:16.551483 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 221/452] 10.222.0.93 () {58 vars in 1282 bytes} [Tue Jul 26 14:38:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 26 14:38:16.557770 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4d5292-6e43-46fc-8036-053f82323e1a None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:16.664792 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4d5292-6e43-46fc-8036-053f82323e1a None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:16.679674 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:38:16.704446 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3cd5ab-ce1d-42df-8b46-d443ccab1c19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:16.705117 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3cd5ab-ce1d-42df-8b46-d443ccab1c19 None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:16.705401 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3cd5ab-ce1d-42df-8b46-d443ccab1c19 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:16.705677 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3cd5ab-ce1d-42df-8b46-d443ccab1c19 None admin] PATH_INFO: `/v3/projects/223cfb51fde24882a520cb183c0f36f8` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:16.706949 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3cd5ab-ce1d-42df-8b46-d443ccab1c19 None admin] RBAC: Authorizing `identity:get_project(project_id=223cfb51fde24882a520cb183c0f36f8)` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:38:16.708423 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3cd5ab-ce1d-42df-8b46-d443ccab1c19 None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:38:16.710336 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 232/453] 10.222.0.93 () {56 vars in 1186 bytes} [Tue Jul 26 14:38:16 2022] GET /identity/v3/projects/223cfb51fde24882a520cb183c0f36f8 => generated 302 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:38:16.716089 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18e77ae-4f1a-4438-bb5c-34e7a310056a None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:16.829535 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:38:16.834512 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18e77ae-4f1a-4438-bb5c-34e7a310056a None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:16.873184 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b443cdb-9046-4be3-9077-ecfa4eb6881f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:16.873907 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b443cdb-9046-4be3-9077-ecfa4eb6881f None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:16.874190 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b443cdb-9046-4be3-9077-ecfa4eb6881f None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:16.874559 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b443cdb-9046-4be3-9077-ecfa4eb6881f None admin] PATH_INFO: `/v3/groups/2c517fc77ff14f6680fe39decfb3c543` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:16.875977 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b443cdb-9046-4be3-9077-ecfa4eb6881f None admin] RBAC: Authorizing `identity:get_group(group_id=2c517fc77ff14f6680fe39decfb3c543)` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:38:16.878097 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b443cdb-9046-4be3-9077-ecfa4eb6881f None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:38:16.880309 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 222/454] 10.222.0.93 () {56 vars in 1180 bytes} [Tue Jul 26 14:38:16 2022] GET /identity/v3/groups/2c517fc77ff14f6680fe39decfb3c543 => generated 226 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:38:16.887467 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3cd5ab-ce1d-42df-8b46-d443ccab1c19 None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:17.006220 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3cd5ab-ce1d-42df-8b46-d443ccab1c19 None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:17.045371 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acfd52e-ffeb-45c1-9355-00cac22e243d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:17.046013 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acfd52e-ffeb-45c1-9355-00cac22e243d None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:17.046321 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acfd52e-ffeb-45c1-9355-00cac22e243d None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:17.046601 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acfd52e-ffeb-45c1-9355-00cac22e243d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:17.047425 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acfd52e-ffeb-45c1-9355-00cac22e243d None admin] RBAC: Adding query filter params (group.id=2c517fc77ff14f6680fe39decfb3c543, role.id=8b8a4a451dc84c17bba824b2ff9cc4fe, scope.project.id=223cfb51fde24882a520cb183c0f36f8) {{(pid=87056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:38:17.047740 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acfd52e-ffeb-45c1-9355-00cac22e243d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:38:17.049284 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acfd52e-ffeb-45c1-9355-00cac22e243d None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:38:17.056223 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 233/455] 10.222.0.93 () {56 vars in 1376 bytes} [Tue Jul 26 14:38:16 2022] GET /identity/v3/role_assignments?group.id=2c517fc77ff14f6680fe39decfb3c543&scope.project.id=223cfb51fde24882a520cb183c0f36f8&role.id=8b8a4a451dc84c17bba824b2ff9cc4fe => generated 611 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:38:20.741096 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b76b3d-c7d6-431e-ab87-393f6a2eddaf None None] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:20.742710 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b76b3d-c7d6-431e-ab87-393f6a2eddaf None None] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:20.742710 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b76b3d-c7d6-431e-ab87-393f6a2eddaf None None] PATH_INFO: `/` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:20.744494 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 223/456] 10.222.0.93 () {54 vars in 926 bytes} [Tue Jul 26 14:38:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 14:38:20.751015 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d87e03-74f0-446a-ab51-2c76af85ad95 None None] REQUEST_METHOD: `POST` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:20.751783 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d87e03-74f0-446a-ab51-2c76af85ad95 None None] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:20.751913 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d87e03-74f0-446a-ab51-2c76af85ad95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:20.800232 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.auth.core [None req-18d87e03-74f0-446a-ab51-2c76af85ad95 None None] MFA Rules not processed for user `e5ef88cc058f425b882bcb87a1e1e75c`. Rule list: `[]` (Enabled: `True`). {{(pid=87056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:38:20.802347 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.fernet_utils [None req-18d87e03-74f0-446a-ab51-2c76af85ad95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:38:20.864031 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935ec37e-d586-4a40-aca8-41b4e00116e5 None None] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:20.864427 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935ec37e-d586-4a40-aca8-41b4e00116e5 None None] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:20.864692 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935ec37e-d586-4a40-aca8-41b4e00116e5 None None] PATH_INFO: `/` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:20.866485 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 224/457] 10.222.0.93 () {54 vars in 926 bytes} [Tue Jul 26 14:38:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:38:20.872090 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf712cd3-3fc1-49c7-a7bf-dfff65eb9934 None None] REQUEST_METHOD: `POST` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:20.872475 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf712cd3-3fc1-49c7-a7bf-dfff65eb9934 None None] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:20.872710 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf712cd3-3fc1-49c7-a7bf-dfff65eb9934 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:20.901079 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:38:20.912772 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.auth.core [None req-cf712cd3-3fc1-49c7-a7bf-dfff65eb9934 None None] MFA Rules not processed for user `e5ef88cc058f425b882bcb87a1e1e75c`. Rule list: `[]` (Enabled: `True`). {{(pid=87055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:38:20.914922 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.fernet_utils [None req-cf712cd3-3fc1-49c7-a7bf-dfff65eb9934 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:38:20.958962 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 234/458] 10.222.0.93 () {58 vars in 1023 bytes} [Tue Jul 26 14:38:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 14:38:20.983446 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d87e03-74f0-446a-ab51-2c76af85ad95 None None] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:21.051914 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 225/459] 10.222.0.93 () {58 vars in 1023 bytes} [Tue Jul 26 14:38:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Jul 26 14:38:21.088891 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf712cd3-3fc1-49c7-a7bf-dfff65eb9934 None None] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:21.228533 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d87e03-74f0-446a-ab51-2c76af85ad95 None None] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:21.249541 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:38:21.261917 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf712cd3-3fc1-49c7-a7bf-dfff65eb9934 None None] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:21.317042 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb4bc86-954e-446f-a5f3-a6527f6b1377 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:21.317972 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb4bc86-954e-446f-a5f3-a6527f6b1377 None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:21.318459 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb4bc86-954e-446f-a5f3-a6527f6b1377 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:21.318883 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb4bc86-954e-446f-a5f3-a6527f6b1377 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:21.344630 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfb30d4-4dd6-4524-a28b-99af85309805 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:21.345732 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb4bc86-954e-446f-a5f3-a6527f6b1377 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:38:21.347489 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb4bc86-954e-446f-a5f3-a6527f6b1377 None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:38:21.348455 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfb30d4-4dd6-4524-a28b-99af85309805 None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:21.348899 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfb30d4-4dd6-4524-a28b-99af85309805 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:21.349413 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfb30d4-4dd6-4524-a28b-99af85309805 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:21.373811 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfb30d4-4dd6-4524-a28b-99af85309805 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:38:21.376925 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfb30d4-4dd6-4524-a28b-99af85309805 None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:38:21.383918 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application [None req-bbb4bc86-954e-446f-a5f3-a6527f6b1377 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:38:21.383918 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:38:21.383918 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:38:21.383918 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:38:21.383918 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:38:21.383918 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:38:21.383918 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:38:21.383918 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:38:21.383918 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:38:21.383918 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:38:21.383918 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:38:21.383918 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:38:21.383918 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 14:38:21.383918 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 14:38:21.383918 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 14:38:21.384946 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 14:38:21.384946 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:38:21.384946 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:38:21.384946 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:38:21.384946 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:38:21.384946 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:38:21.384946 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:38:21.384946 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:38:21.384946 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application with Lock( Jul 26 14:38:21.384946 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:38:21.384946 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:38:21.384946 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:38:21.384946 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:38:21.384946 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:38:21.384946 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:38:21.384946 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:38:21.384946 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:38:21.385879 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 14:38:21.385879 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 14:38:21.385879 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:38:21.385879 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Jul 26 14:38:21.388723 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 235/460] 10.222.0.93 () {56 vars in 1108 bytes} [Tue Jul 26 14:38:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 406 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:38:21.396357 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb4bc86-954e-446f-a5f3-a6527f6b1377 None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:21.415273 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application [None req-4dfb30d4-4dd6-4524-a28b-99af85309805 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:38:21.415273 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:38:21.415273 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:38:21.415273 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:38:21.415273 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:38:21.415273 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:38:21.415273 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:38:21.415273 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:38:21.415273 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:38:21.415273 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:38:21.415273 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:38:21.415273 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:38:21.415273 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 14:38:21.415273 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 14:38:21.415273 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 14:38:21.416284 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 14:38:21.416284 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:38:21.416284 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:38:21.416284 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:38:21.416284 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:38:21.416284 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:38:21.416284 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:38:21.416284 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:38:21.416284 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application with Lock( Jul 26 14:38:21.416284 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:38:21.416284 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:38:21.416284 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:38:21.416284 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:38:21.416284 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:38:21.416284 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:38:21.416284 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:38:21.416284 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:38:21.417188 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 14:38:21.417188 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 14:38:21.417188 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:38:21.417188 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Jul 26 14:38:21.419282 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 226/461] 10.222.0.93 () {56 vars in 1108 bytes} [Tue Jul 26 14:38:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 331 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:38:21.425405 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfb30d4-4dd6-4524-a28b-99af85309805 None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:21.475600 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:38:21.556390 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfb30d4-4dd6-4524-a28b-99af85309805 None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:21.599469 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38a46b0-933e-4b0f-a781-7fcac55c4038 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:21.600355 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38a46b0-933e-4b0f-a781-7fcac55c4038 None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:21.601137 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38a46b0-933e-4b0f-a781-7fcac55c4038 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:21.601642 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38a46b0-933e-4b0f-a781-7fcac55c4038 None admin] PATH_INFO: `/v3/domains` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:21.603109 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38a46b0-933e-4b0f-a781-7fcac55c4038 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:38:21.603589 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38a46b0-933e-4b0f-a781-7fcac55c4038 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:38:21.605947 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38a46b0-933e-4b0f-a781-7fcac55c4038 None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:38:21.643231 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 227/462] 10.222.0.93 () {56 vars in 1109 bytes} [Tue Jul 26 14:38:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:38:21.653610 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092042fd-52cf-475f-ae4e-e06f2eebc5d2 None None] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:21.661502 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092042fd-52cf-475f-ae4e-e06f2eebc5d2 None None] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:21.662129 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092042fd-52cf-475f-ae4e-e06f2eebc5d2 None None] PATH_INFO: `/` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:21.665036 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 228/463] 10.222.0.93 () {54 vars in 926 bytes} [Tue Jul 26 14:38:21 2022] GET /identity => generated 270 bytes in 21 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:38:21.666129 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092042fd-52cf-475f-ae4e-e06f2eebc5d2 None None] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:21.684569 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:38:21.698225 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb4bc86-954e-446f-a5f3-a6527f6b1377 None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:21.771283 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5837926b-5394-4eae-919f-acaa75905d99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:21.773596 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5837926b-5394-4eae-919f-acaa75905d99 None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:21.774600 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5837926b-5394-4eae-919f-acaa75905d99 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:21.775333 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5837926b-5394-4eae-919f-acaa75905d99 None admin] PATH_INFO: `/v3/domains` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:21.777003 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5837926b-5394-4eae-919f-acaa75905d99 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:38:21.777755 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5837926b-5394-4eae-919f-acaa75905d99 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:38:21.780804 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5837926b-5394-4eae-919f-acaa75905d99 None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:38:21.806266 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 236/464] 10.222.0.93 () {56 vars in 1109 bytes} [Tue Jul 26 14:38:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 411 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:38:21.809293 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82bd1f8-3fe7-4867-a632-036b2769a41d None None] REQUEST_METHOD: `POST` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:21.810061 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82bd1f8-3fe7-4867-a632-036b2769a41d None None] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:21.810767 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82bd1f8-3fe7-4867-a632-036b2769a41d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:21.846731 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092042fd-52cf-475f-ae4e-e06f2eebc5d2 None None] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:21.850896 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.auth.core [None req-a82bd1f8-3fe7-4867-a632-036b2769a41d None None] MFA Rules not processed for user `e5ef88cc058f425b882bcb87a1e1e75c`. Rule list: `[]` (Enabled: `True`). {{(pid=87056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:38:21.856583 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.fernet_utils [None req-a82bd1f8-3fe7-4867-a632-036b2769a41d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:38:21.925938 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138d04eb-012a-4e0c-a798-cdca4c1ea053 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:21.927073 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138d04eb-012a-4e0c-a798-cdca4c1ea053 None admin] REQUEST_METHOD: `POST` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:21.927583 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138d04eb-012a-4e0c-a798-cdca4c1ea053 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:21.928101 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138d04eb-012a-4e0c-a798-cdca4c1ea053 None admin] PATH_INFO: `/v3/users` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:21.929991 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138d04eb-012a-4e0c-a798-cdca4c1ea053 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:38:21.932789 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138d04eb-012a-4e0c-a798-cdca4c1ea053 None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:38:21.963144 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 237/465] 10.222.0.93 () {58 vars in 1023 bytes} [Tue Jul 26 14:38:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 14:38:21.964030 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82bd1f8-3fe7-4867-a632-036b2769a41d None None] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:21.992639 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:38:22.078880 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 229/466] 10.222.0.93 () {60 vars in 1132 bytes} [Tue Jul 26 14:38:21 2022] POST /identity/v3/users => generated 246 bytes in 413 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 14:38:22.081168 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3d7a08-b57c-460a-858b-3ae58a31b239 None None] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:22.081580 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3d7a08-b57c-460a-858b-3ae58a31b239 None None] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:22.082045 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3d7a08-b57c-460a-858b-3ae58a31b239 None None] PATH_INFO: `/` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:22.084768 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 230/467] 10.222.0.93 () {54 vars in 926 bytes} [Tue Jul 26 14:38:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:38:22.094442 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3d7a08-b57c-460a-858b-3ae58a31b239 None None] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:22.137379 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82bd1f8-3fe7-4867-a632-036b2769a41d None None] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:22.204797 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:38:22.215436 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca27cdf-5b61-4835-91f3-2f05760cdfd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:22.216758 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca27cdf-5b61-4835-91f3-2f05760cdfd7 None admin] REQUEST_METHOD: `POST` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:22.218416 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca27cdf-5b61-4835-91f3-2f05760cdfd7 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:22.218416 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca27cdf-5b61-4835-91f3-2f05760cdfd7 None admin] PATH_INFO: `/v3/users` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:22.219515 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca27cdf-5b61-4835-91f3-2f05760cdfd7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:38:22.222802 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca27cdf-5b61-4835-91f3-2f05760cdfd7 None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:38:22.259579 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3d7a08-b57c-460a-858b-3ae58a31b239 None None] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:22.332423 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 238/468] 10.222.0.93 () {60 vars in 1132 bytes} [Tue Jul 26 14:38:21 2022] POST /identity/v3/users => generated 248 bytes in 368 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 14:38:22.333887 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c76748-e223-415b-af86-c44dff826f4c None None] REQUEST_METHOD: `POST` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:22.334355 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c76748-e223-415b-af86-c44dff826f4c None None] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:22.334663 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c76748-e223-415b-af86-c44dff826f4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:22.335278 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6612421a-4cb4-4001-9425-9ec934c33824 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:22.336400 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6612421a-4cb4-4001-9425-9ec934c33824 None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:22.336895 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6612421a-4cb4-4001-9425-9ec934c33824 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:22.337396 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6612421a-4cb4-4001-9425-9ec934c33824 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:22.360739 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6612421a-4cb4-4001-9425-9ec934c33824 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:38:22.363630 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.auth.core [None req-96c76748-e223-415b-af86-c44dff826f4c None None] MFA Rules not processed for user `e5ef88cc058f425b882bcb87a1e1e75c`. Rule list: `[]` (Enabled: `True`). {{(pid=87056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:38:22.363935 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6612421a-4cb4-4001-9425-9ec934c33824 None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:38:22.365510 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.fernet_utils [None req-96c76748-e223-415b-af86-c44dff826f4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:38:22.400167 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application [None req-6612421a-4cb4-4001-9425-9ec934c33824 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:38:22.400167 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:38:22.400167 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:38:22.400167 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:38:22.400167 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:38:22.400167 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:38:22.400167 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:38:22.400167 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:38:22.400167 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:38:22.400167 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:38:22.400167 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:38:22.400167 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:38:22.400167 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 14:38:22.400167 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 14:38:22.400167 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 14:38:22.402225 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 14:38:22.402225 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:38:22.402225 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:38:22.402225 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:38:22.402225 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:38:22.402225 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:38:22.402225 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:38:22.402225 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:38:22.402225 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application with Lock( Jul 26 14:38:22.402225 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:38:22.402225 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:38:22.402225 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:38:22.402225 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:38:22.402225 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:38:22.402225 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:38:22.402225 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:38:22.402225 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:38:22.404501 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 14:38:22.404501 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 14:38:22.404501 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:38:22.404501 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Jul 26 14:38:22.404501 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 231/469] 10.222.0.93 () {56 vars in 1108 bytes} [Tue Jul 26 14:38:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 318 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:38:22.417089 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6612421a-4cb4-4001-9425-9ec934c33824 None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:22.534091 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 239/470] 10.222.0.93 () {58 vars in 1023 bytes} [Tue Jul 26 14:38:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 14:38:22.536021 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942b2e4d-b821-4c6d-9974-6a8162866ea9 None None] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:22.536325 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942b2e4d-b821-4c6d-9974-6a8162866ea9 None None] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:22.536653 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942b2e4d-b821-4c6d-9974-6a8162866ea9 None None] PATH_INFO: `/` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:22.542642 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 240/471] 10.222.0.93 () {54 vars in 926 bytes} [Tue Jul 26 14:38:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:38:22.551338 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65bc858-7b24-4075-a716-ea43f21338e8 None None] REQUEST_METHOD: `POST` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:22.551628 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65bc858-7b24-4075-a716-ea43f21338e8 None None] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:22.551950 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65bc858-7b24-4075-a716-ea43f21338e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:22.574671 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:38:22.585765 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.auth.core [None req-c65bc858-7b24-4075-a716-ea43f21338e8 None None] MFA Rules not processed for user `e5ef88cc058f425b882bcb87a1e1e75c`. Rule list: `[]` (Enabled: `True`). {{(pid=87056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:38:22.587294 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.fernet_utils [None req-c65bc858-7b24-4075-a716-ea43f21338e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:38:22.627090 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6612421a-4cb4-4001-9425-9ec934c33824 None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:22.673555 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:38:22.715141 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bee169-e557-4728-a087-dc816be1066c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:22.716250 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bee169-e557-4728-a087-dc816be1066c None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:22.716679 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bee169-e557-4728-a087-dc816be1066c None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:22.717092 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bee169-e557-4728-a087-dc816be1066c None admin] PATH_INFO: `/v3/domains` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:22.717987 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bee169-e557-4728-a087-dc816be1066c None admin] RBAC: Adding query filter params (name=Default) {{(pid=87055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:38:22.718669 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bee169-e557-4728-a087-dc816be1066c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:38:22.719113 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 241/472] 10.222.0.93 () {58 vars in 1023 bytes} [Tue Jul 26 14:38:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 14:38:22.720625 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bee169-e557-4728-a087-dc816be1066c None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:38:22.720757 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65bc858-7b24-4075-a716-ea43f21338e8 None None] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:22.735574 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 232/473] 10.222.0.93 () {56 vars in 1109 bytes} [Tue Jul 26 14:38:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:38:22.742328 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bee169-e557-4728-a087-dc816be1066c None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:22.892905 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65bc858-7b24-4075-a716-ea43f21338e8 None None] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:22.937563 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06f3dec-a403-4007-9c9a-05e43b8f115a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:22.938665 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06f3dec-a403-4007-9c9a-05e43b8f115a None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:22.939598 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06f3dec-a403-4007-9c9a-05e43b8f115a None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:22.940080 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06f3dec-a403-4007-9c9a-05e43b8f115a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:22.943991 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bee169-e557-4728-a087-dc816be1066c None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:22.954800 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06f3dec-a403-4007-9c9a-05e43b8f115a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:38:22.956650 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06f3dec-a403-4007-9c9a-05e43b8f115a None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:38:22.959935 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:38:22.994233 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application [None req-a06f3dec-a403-4007-9c9a-05e43b8f115a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:38:22.994233 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:38:22.994233 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:38:22.994233 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:38:22.994233 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:38:22.994233 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:38:22.994233 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:38:22.994233 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:38:22.994233 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:38:22.994233 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:38:22.994233 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:38:22.994233 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:38:22.994233 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 14:38:22.994233 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 14:38:22.994233 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 14:38:22.995493 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 14:38:22.995493 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:38:22.995493 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:38:22.995493 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:38:22.995493 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:38:22.995493 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:38:22.995493 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:38:22.995493 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:38:22.995493 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application with Lock( Jul 26 14:38:22.995493 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:38:22.995493 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:38:22.995493 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:38:22.995493 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:38:22.995493 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:38:22.995493 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:38:22.995493 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:38:22.995493 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:38:22.997208 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 14:38:22.997208 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 14:38:22.997208 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:38:22.997208 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Jul 26 14:38:23.007373 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 242/474] 10.222.0.93 () {56 vars in 1108 bytes} [Tue Jul 26 14:38:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:38:23.009264 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06f3dec-a403-4007-9c9a-05e43b8f115a None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:23.024259 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50722af7-37a4-4832-8945-b97191c70b1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:23.025353 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50722af7-37a4-4832-8945-b97191c70b1f None admin] REQUEST_METHOD: `POST` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:23.025865 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50722af7-37a4-4832-8945-b97191c70b1f None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:23.026419 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50722af7-37a4-4832-8945-b97191c70b1f None admin] PATH_INFO: `/v3/users` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:23.027800 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50722af7-37a4-4832-8945-b97191c70b1f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:38:23.030285 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50722af7-37a4-4832-8945-b97191c70b1f None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:38:23.178113 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 233/475] 10.222.0.93 () {60 vars in 1132 bytes} [Tue Jul 26 14:38:22 2022] POST /identity/v3/users => generated 248 bytes in 434 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 14:38:23.178113 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50722af7-37a4-4832-8945-b97191c70b1f None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:23.182209 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06f3dec-a403-4007-9c9a-05e43b8f115a None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:23.274419 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:38:23.278736 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcd3a90-5a0e-4ce5-a46f-593e4a527501 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:23.279476 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcd3a90-5a0e-4ce5-a46f-593e4a527501 None admin] REQUEST_METHOD: `POST` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:23.279744 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcd3a90-5a0e-4ce5-a46f-593e4a527501 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:23.280057 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcd3a90-5a0e-4ce5-a46f-593e4a527501 None admin] PATH_INFO: `/v3/roles` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:23.280844 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcd3a90-5a0e-4ce5-a46f-593e4a527501 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:38:23.285043 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcd3a90-5a0e-4ce5-a46f-593e4a527501 None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:38:23.339886 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.sql.core [None req-9bcd3a90-5a0e-4ce5-a46f-593e4a527501 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 26 14:38:23.339886 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 26 14:38:23.339886 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [parameters: {'id': '2cf9b2a9cdc44b80b70e0f70761fe98a', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 26 14:38:23.339886 dv-cinder-851030-1-smb devstack@keystone.service[87056]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=87056) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 26 14:38:23.367973 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application [None req-9bcd3a90-5a0e-4ce5-a46f-593e4a527501 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 26 14:38:23.367973 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:38:23.367973 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 26 14:38:23.367973 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 26 14:38:23.367973 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 26 14:38:23.367973 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 26 14:38:23.367973 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 26 14:38:23.367973 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application result = self._query(query) Jul 26 14:38:23.367973 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 26 14:38:23.367973 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application conn.query(q) Jul 26 14:38:23.367973 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 26 14:38:23.367973 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 26 14:38:23.367973 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 26 14:38:23.367973 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application result.read() Jul 26 14:38:23.367973 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 26 14:38:23.369642 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 26 14:38:23.369642 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 26 14:38:23.369642 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 26 14:38:23.369642 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 26 14:38:23.369642 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 26 14:38:23.369642 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 26 14:38:23.369642 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 26 14:38:23.369642 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 26 14:38:23.369642 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Jul 26 14:38:23.369642 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 26 14:38:23.369642 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Jul 26 14:38:23.369642 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:38:23.369642 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 26 14:38:23.369642 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 26 14:38:23.369642 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jul 26 14:38:23.369642 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return ref.to_dict() Jul 26 14:38:23.369642 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 26 14:38:23.369642 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application next(self.gen) Jul 26 14:38:23.371439 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 26 14:38:23.371439 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application yield resource Jul 26 14:38:23.371439 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 26 14:38:23.371439 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application next(self.gen) Jul 26 14:38:23.371439 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 26 14:38:23.371439 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application self.session.rollback() Jul 26 14:38:23.371439 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 26 14:38:23.371439 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application self.force_reraise() Jul 26 14:38:23.371439 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 26 14:38:23.371439 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application raise self.value Jul 26 14:38:23.371439 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 26 14:38:23.371439 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 26 14:38:23.371439 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 26 14:38:23.371439 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application session.commit() Jul 26 14:38:23.371439 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 26 14:38:23.371439 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 26 14:38:23.371439 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 26 14:38:23.374304 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application self._prepare_impl() Jul 26 14:38:23.374304 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 26 14:38:23.374304 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application self.session.flush() Jul 26 14:38:23.374304 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 26 14:38:23.374304 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application self._flush(objects) Jul 26 14:38:23.374304 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 26 14:38:23.374304 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 26 14:38:23.374304 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 26 14:38:23.374304 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application compat.raise_( Jul 26 14:38:23.374304 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 26 14:38:23.374304 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application raise exception Jul 26 14:38:23.374304 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 26 14:38:23.374304 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application flush_context.execute() Jul 26 14:38:23.374304 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 26 14:38:23.374304 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application rec.execute(self) Jul 26 14:38:23.374304 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 26 14:38:23.374304 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 26 14:38:23.377769 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 26 14:38:23.377769 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 26 14:38:23.377769 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 26 14:38:23.377769 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 26 14:38:23.377769 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 26 14:38:23.377769 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 26 14:38:23.377769 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 26 14:38:23.377769 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 26 14:38:23.377769 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 26 14:38:23.377769 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 26 14:38:23.377769 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 26 14:38:23.377769 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 26 14:38:23.377769 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 26 14:38:23.377769 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 26 14:38:23.377769 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 26 14:38:23.377769 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application raise exception Jul 26 14:38:23.388728 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 26 14:38:23.388728 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 26 14:38:23.388728 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 26 14:38:23.388728 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 26 14:38:23.388728 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 26 14:38:23.388728 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application result = self._query(query) Jul 26 14:38:23.388728 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 26 14:38:23.388728 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application conn.query(q) Jul 26 14:38:23.388728 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 26 14:38:23.388728 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 26 14:38:23.388728 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 26 14:38:23.388728 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application result.read() Jul 26 14:38:23.388728 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 26 14:38:23.388728 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 26 14:38:23.388728 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 26 14:38:23.388728 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 26 14:38:23.391909 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 26 14:38:23.391909 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 26 14:38:23.391909 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 26 14:38:23.391909 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 26 14:38:23.391909 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 26 14:38:23.391909 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 26 14:38:23.391909 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application [parameters: {'id': '2cf9b2a9cdc44b80b70e0f70761fe98a', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 26 14:38:23.391909 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 26 14:38:23.391909 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Jul 26 14:38:23.391909 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 14:38:23.391909 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Jul 26 14:38:23.391909 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:38:23.391909 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:38:23.391909 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:38:23.391909 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:38:23.391909 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:38:23.399676 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:38:23.399676 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:38:23.399676 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:38:23.399676 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:38:23.399676 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:38:23.399676 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:38:23.399676 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jul 26 14:38:23.399676 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jul 26 14:38:23.399676 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:38:23.399676 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:38:23.399676 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jul 26 14:38:23.399676 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jul 26 14:38:23.399676 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 26 14:38:23.399676 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 26 14:38:23.399676 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 26 14:38:23.399676 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Jul 26 14:38:23.403100 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 243/476] 10.222.0.93 () {60 vars in 1131 bytes} [Tue Jul 26 14:38:23 2022] POST /identity/v3/roles => generated 144 bytes in 369 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:38:23.403100 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcd3a90-5a0e-4ce5-a46f-593e4a527501 None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:23.432713 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50722af7-37a4-4832-8945-b97191c70b1f None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:23.502932 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51d9b6d-36a9-4a61-beed-6a579f9f51d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:23.503579 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51d9b6d-36a9-4a61-beed-6a579f9f51d3 None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:23.503866 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51d9b6d-36a9-4a61-beed-6a579f9f51d3 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:23.504211 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51d9b6d-36a9-4a61-beed-6a579f9f51d3 None admin] PATH_INFO: `/v3/domains` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:23.504994 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51d9b6d-36a9-4a61-beed-6a579f9f51d3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:38:23.509135 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51d9b6d-36a9-4a61-beed-6a579f9f51d3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:38:23.509135 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51d9b6d-36a9-4a61-beed-6a579f9f51d3 None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:38:23.530296 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 234/477] 10.222.0.93 () {56 vars in 1109 bytes} [Tue Jul 26 14:38:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 349 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:38:23.533208 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:38:23.533987 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51d9b6d-36a9-4a61-beed-6a579f9f51d3 None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:23.605929 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcd3a90-5a0e-4ce5-a46f-593e4a527501 None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:23.676774 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bc9416-c6b3-4894-ab4f-958d792ee0dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:23.678434 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bc9416-c6b3-4894-ab4f-958d792ee0dc None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:23.679317 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bc9416-c6b3-4894-ab4f-958d792ee0dc None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:23.680130 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bc9416-c6b3-4894-ab4f-958d792ee0dc None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:23.708988 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bc9416-c6b3-4894-ab4f-958d792ee0dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 14:38:23.724108 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application [None req-83bc9416-c6b3-4894-ab4f-958d792ee0dc None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 14:38:23.724108 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:38:23.724108 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:38:23.724108 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:38:23.724108 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:38:23.724108 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:38:23.724108 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:38:23.724108 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:38:23.724108 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:38:23.724108 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:38:23.724108 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:38:23.724108 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:38:23.724108 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 14:38:23.724108 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 14:38:23.724108 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 14:38:23.724108 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 14:38:23.727134 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 14:38:23.727134 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 14:38:23.727134 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 14:38:23.727134 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 14:38:23.727134 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:38:23.727134 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:38:23.727134 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:38:23.727134 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:38:23.727134 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:38:23.727134 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:38:23.727134 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:38:23.727134 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application with Lock( Jul 26 14:38:23.727134 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:38:23.727134 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:38:23.727134 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:38:23.727134 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:38:23.734645 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:38:23.734645 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:38:23.734645 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:38:23.734645 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:38:23.734645 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 14:38:23.734645 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 14:38:23.734645 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 14:38:23.734645 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 14:38:23.734645 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 14:38:23.734645 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 14:38:23.734645 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 14:38:23.734645 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Jul 26 14:38:23.742502 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:38:23.742502 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51d9b6d-36a9-4a61-beed-6a579f9f51d3 None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:23.742951 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 244/478] 10.222.0.93 () {56 vars in 1114 bytes} [Tue Jul 26 14:38:23 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 338 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:38:23.742951 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bc9416-c6b3-4894-ab4f-958d792ee0dc None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:23.793156 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159cafb7-2b8c-490c-8adb-6dbb32972058 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:23.794277 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159cafb7-2b8c-490c-8adb-6dbb32972058 None admin] REQUEST_METHOD: `POST` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:23.794795 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159cafb7-2b8c-490c-8adb-6dbb32972058 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:23.795301 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159cafb7-2b8c-490c-8adb-6dbb32972058 None admin] PATH_INFO: `/v3/users` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:23.796608 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159cafb7-2b8c-490c-8adb-6dbb32972058 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:38:23.798922 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159cafb7-2b8c-490c-8adb-6dbb32972058 None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:38:23.923048 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bc9416-c6b3-4894-ab4f-958d792ee0dc None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:23.943541 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:38:23.989943 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b0f91b-aff6-4241-b5bf-ba8782066780 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:23.991515 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b0f91b-aff6-4241-b5bf-ba8782066780 None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:23.992000 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b0f91b-aff6-4241-b5bf-ba8782066780 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:23.992495 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b0f91b-aff6-4241-b5bf-ba8782066780 None admin] PATH_INFO: `/v3/roles` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:23.993568 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b0f91b-aff6-4241-b5bf-ba8782066780 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:38:23.993955 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b0f91b-aff6-4241-b5bf-ba8782066780 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:38:23.996145 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b0f91b-aff6-4241-b5bf-ba8782066780 None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:38:23.998740 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 235/479] 10.222.0.93 () {60 vars in 1132 bytes} [Tue Jul 26 14:38:23 2022] POST /identity/v3/users => generated 249 bytes in 465 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 14:38:24.013737 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 245/480] 10.222.0.93 () {56 vars in 1111 bytes} [Tue Jul 26 14:38:23 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:38:25.183087 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ec5f92-a894-499f-999b-dc6f511b393c None None] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:25.183922 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ec5f92-a894-499f-999b-dc6f511b393c None None] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:25.184053 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ec5f92-a894-499f-999b-dc6f511b393c None None] PATH_INFO: `/` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:25.187207 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 236/481] 10.222.0.93 () {54 vars in 926 bytes} [Tue Jul 26 14:38:25 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:38:25.196683 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060443e6-9b20-4c0a-8166-2829d655c8fd None None] REQUEST_METHOD: `POST` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:25.197462 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060443e6-9b20-4c0a-8166-2829d655c8fd None None] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:25.197644 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060443e6-9b20-4c0a-8166-2829d655c8fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:25.234698 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.auth.core [None req-060443e6-9b20-4c0a-8166-2829d655c8fd None None] MFA Rules not processed for user `e5ef88cc058f425b882bcb87a1e1e75c`. Rule list: `[]` (Enabled: `True`). {{(pid=87056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:38:25.237053 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.fernet_utils [None req-060443e6-9b20-4c0a-8166-2829d655c8fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:38:25.372880 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 246/482] 10.222.0.93 () {58 vars in 1023 bytes} [Tue Jul 26 14:38:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 14:38:25.445686 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ec5f92-a894-499f-999b-dc6f511b393c None None] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:25.681113 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ec5f92-a894-499f-999b-dc6f511b393c None None] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:25.747328 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da1d4db-7cc7-428f-9906-d71f4fe02fe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:25.747919 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da1d4db-7cc7-428f-9906-d71f4fe02fe4 None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:25.748216 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da1d4db-7cc7-428f-9906-d71f4fe02fe4 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:25.748501 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da1d4db-7cc7-428f-9906-d71f4fe02fe4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:25.765096 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da1d4db-7cc7-428f-9906-d71f4fe02fe4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 14:38:25.770193 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application [None req-2da1d4db-7cc7-428f-9906-d71f4fe02fe4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 26 14:38:25.770193 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:38:25.770193 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:38:25.770193 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:38:25.770193 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:38:25.770193 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:38:25.770193 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:38:25.770193 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:38:25.770193 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:38:25.770193 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:38:25.770193 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:38:25.770193 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:38:25.770193 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 14:38:25.770193 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 14:38:25.770193 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 14:38:25.770193 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 14:38:25.773567 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 14:38:25.773567 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 14:38:25.773567 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 14:38:25.773567 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 14:38:25.773567 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:38:25.773567 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:38:25.773567 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:38:25.773567 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:38:25.773567 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:38:25.773567 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:38:25.773567 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:38:25.773567 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application with Lock( Jul 26 14:38:25.773567 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:38:25.773567 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:38:25.773567 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:38:25.773567 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:38:25.776582 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:38:25.776582 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:38:25.776582 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:38:25.776582 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:38:25.776582 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 14:38:25.776582 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 14:38:25.776582 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 14:38:25.776582 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 14:38:25.776582 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 14:38:25.776582 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 14:38:25.776582 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 26 14:38:25.776582 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Jul 26 14:38:25.776582 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 237/483] 10.222.0.93 () {56 vars in 1102 bytes} [Tue Jul 26 14:38:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 328 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:38:25.788901 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060443e6-9b20-4c0a-8166-2829d655c8fd None None] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:25.922542 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:38:25.930334 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060443e6-9b20-4c0a-8166-2829d655c8fd None None] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:25.974143 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9448f8f-8b78-4f9b-8a54-269a135a03ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:25.974824 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9448f8f-8b78-4f9b-8a54-269a135a03ff None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:25.975111 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9448f8f-8b78-4f9b-8a54-269a135a03ff None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:25.976045 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9448f8f-8b78-4f9b-8a54-269a135a03ff None admin] PATH_INFO: `/v3/roles` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:25.976819 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9448f8f-8b78-4f9b-8a54-269a135a03ff None admin] RBAC: Adding query filter params (name=service) {{(pid=87056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:38:25.977134 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9448f8f-8b78-4f9b-8a54-269a135a03ff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:38:25.978598 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9448f8f-8b78-4f9b-8a54-269a135a03ff None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:38:25.993723 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 247/484] 10.222.0.93 () {56 vars in 1103 bytes} [Tue Jul 26 14:38:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:38:26.003220 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da1d4db-7cc7-428f-9906-d71f4fe02fe4 None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:26.021213 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:38:26.126093 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4e5701-e239-4ad1-b808-e9d2db1a6d6e None None] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:26.126093 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4e5701-e239-4ad1-b808-e9d2db1a6d6e None None] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:26.126093 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4e5701-e239-4ad1-b808-e9d2db1a6d6e None None] PATH_INFO: `/` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:26.126093 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 248/485] 10.222.0.93 () {54 vars in 926 bytes} [Tue Jul 26 14:38:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:38:26.164067 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d4b580-4f05-44a0-9c1f-e64558609c06 None None] REQUEST_METHOD: `POST` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:26.164340 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d4b580-4f05-44a0-9c1f-e64558609c06 None None] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:26.164640 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d4b580-4f05-44a0-9c1f-e64558609c06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:26.183751 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da1d4db-7cc7-428f-9906-d71f4fe02fe4 None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:26.207881 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.auth.core [None req-c1d4b580-4f05-44a0-9c1f-e64558609c06 None None] MFA Rules not processed for user `e5ef88cc058f425b882bcb87a1e1e75c`. Rule list: `[]` (Enabled: `True`). {{(pid=87056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:38:26.208717 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.fernet_utils [None req-c1d4b580-4f05-44a0-9c1f-e64558609c06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:38:26.269664 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd364d2c-eae1-4d70-9c8a-cd40386a901c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:26.271343 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd364d2c-eae1-4d70-9c8a-cd40386a901c None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:26.272121 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd364d2c-eae1-4d70-9c8a-cd40386a901c None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:26.272940 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd364d2c-eae1-4d70-9c8a-cd40386a901c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:26.307320 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd364d2c-eae1-4d70-9c8a-cd40386a901c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:38:26.309424 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd364d2c-eae1-4d70-9c8a-cd40386a901c None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:38:26.343699 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application [None req-fd364d2c-eae1-4d70-9c8a-cd40386a901c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:38:26.343699 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:38:26.343699 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:38:26.343699 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:38:26.343699 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:38:26.343699 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:38:26.343699 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:38:26.343699 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:38:26.343699 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:38:26.343699 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:38:26.343699 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:38:26.343699 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:38:26.343699 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 14:38:26.343699 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 14:38:26.343699 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 14:38:26.344679 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 14:38:26.344679 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:38:26.344679 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:38:26.344679 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:38:26.344679 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:38:26.344679 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:38:26.344679 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:38:26.344679 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:38:26.344679 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application with Lock( Jul 26 14:38:26.344679 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:38:26.344679 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:38:26.344679 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:38:26.344679 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:38:26.344679 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:38:26.344679 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:38:26.344679 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:38:26.344679 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:38:26.345550 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 14:38:26.345550 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 14:38:26.345550 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:38:26.345550 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Jul 26 14:38:26.355218 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 238/486] 10.222.0.93 () {56 vars in 1108 bytes} [Tue Jul 26 14:38:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 349 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 14:38:26.356268 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd364d2c-eae1-4d70-9c8a-cd40386a901c None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:26.389717 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 249/487] 10.222.0.93 () {58 vars in 1023 bytes} [Tue Jul 26 14:38:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 14:38:26.417494 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d4b580-4f05-44a0-9c1f-e64558609c06 None None] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:26.506685 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:38:26.592833 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd364d2c-eae1-4d70-9c8a-cd40386a901c None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:26.618358 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:38:26.630074 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d4b580-4f05-44a0-9c1f-e64558609c06 None None] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:26.640211 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d88786-27b8-4647-9c0c-5729f62ba48c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:26.640936 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d88786-27b8-4647-9c0c-5729f62ba48c None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:26.641220 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d88786-27b8-4647-9c0c-5729f62ba48c None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:26.641502 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d88786-27b8-4647-9c0c-5729f62ba48c None admin] PATH_INFO: `/v3/domains` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:26.642263 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d88786-27b8-4647-9c0c-5729f62ba48c None admin] RBAC: Adding query filter params (name=Default) {{(pid=87055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:38:26.642653 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d88786-27b8-4647-9c0c-5729f62ba48c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:38:26.644254 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d88786-27b8-4647-9c0c-5729f62ba48c None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:38:26.674962 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 239/488] 10.222.0.93 () {56 vars in 1109 bytes} [Tue Jul 26 14:38:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:38:26.681589 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d88786-27b8-4647-9c0c-5729f62ba48c None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:26.717821 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b628d42f-1fda-4953-b17b-26ac2d0e6ae6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:26.718521 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b628d42f-1fda-4953-b17b-26ac2d0e6ae6 None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:26.718811 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b628d42f-1fda-4953-b17b-26ac2d0e6ae6 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:26.719091 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b628d42f-1fda-4953-b17b-26ac2d0e6ae6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:26.740908 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b628d42f-1fda-4953-b17b-26ac2d0e6ae6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 14:38:26.749323 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application [None req-b628d42f-1fda-4953-b17b-26ac2d0e6ae6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 26 14:38:26.749323 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:38:26.749323 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:38:26.749323 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:38:26.749323 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:38:26.749323 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:38:26.749323 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:38:26.749323 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:38:26.749323 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:38:26.749323 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:38:26.749323 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:38:26.749323 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:38:26.749323 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 14:38:26.749323 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 14:38:26.749323 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 14:38:26.749323 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 14:38:26.750362 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 14:38:26.750362 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 14:38:26.750362 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 14:38:26.750362 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 14:38:26.750362 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:38:26.750362 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:38:26.750362 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:38:26.750362 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:38:26.750362 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:38:26.750362 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:38:26.750362 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:38:26.750362 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application with Lock( Jul 26 14:38:26.750362 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:38:26.750362 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:38:26.750362 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:38:26.750362 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:38:26.751194 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:38:26.751194 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:38:26.751194 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:38:26.751194 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:38:26.751194 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 14:38:26.751194 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 14:38:26.751194 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 14:38:26.751194 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 14:38:26.751194 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 14:38:26.751194 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 14:38:26.751194 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 26 14:38:26.751194 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Jul 26 14:38:26.751194 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 250/489] 10.222.0.93 () {56 vars in 1102 bytes} [Tue Jul 26 14:38:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 334 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 14:38:26.752396 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a016d93-3517-47d5-be7f-e296554d06ed None None] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:26.752564 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a016d93-3517-47d5-be7f-e296554d06ed None None] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:26.758302 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a016d93-3517-47d5-be7f-e296554d06ed None None] PATH_INFO: `/` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:26.758302 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 251/490] 10.222.0.93 () {54 vars in 926 bytes} [Tue Jul 26 14:38:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:38:26.759333 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a016d93-3517-47d5-be7f-e296554d06ed None None] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:26.839940 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d88786-27b8-4647-9c0c-5729f62ba48c None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:26.864285 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:38:26.879585 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62cbe57-2254-4079-bd55-c71126c03a76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:26.880294 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62cbe57-2254-4079-bd55-c71126c03a76 None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:26.880535 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62cbe57-2254-4079-bd55-c71126c03a76 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:26.880866 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62cbe57-2254-4079-bd55-c71126c03a76 None admin] PATH_INFO: `/v3/users/glance` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:26.890800 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62cbe57-2254-4079-bd55-c71126c03a76 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:38:26.891139 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a016d93-3517-47d5-be7f-e296554d06ed None None] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:26.892274 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62cbe57-2254-4079-bd55-c71126c03a76 None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:38:26.909488 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application [None req-d62cbe57-2254-4079-bd55-c71126c03a76 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 26 14:38:26.909488 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:38:26.909488 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:38:26.909488 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:38:26.909488 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:38:26.909488 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:38:26.909488 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:38:26.909488 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:38:26.909488 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:38:26.909488 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:38:26.909488 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:38:26.909488 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:38:26.909488 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 14:38:26.909488 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 14:38:26.909488 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 14:38:26.909488 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 14:38:26.910571 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:38:26.910571 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:38:26.910571 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 14:38:26.910571 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 14:38:26.910571 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 14:38:26.910571 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 14:38:26.910571 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:38:26.910571 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:38:26.910571 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:38:26.910571 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:38:26.910571 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:38:26.910571 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application with Lock( Jul 26 14:38:26.910571 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:38:26.910571 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:38:26.910571 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:38:26.910571 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:38:26.910571 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:38:26.910571 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:38:26.911480 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:38:26.911480 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:38:26.911480 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 14:38:26.911480 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 14:38:26.911480 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 14:38:26.911480 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 14:38:26.911480 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 14:38:26.911480 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 14:38:26.911480 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 26 14:38:26.911480 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Jul 26 14:38:26.911480 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 240/491] 10.222.0.93 () {56 vars in 1099 bytes} [Tue Jul 26 14:38:26 2022] GET /identity/v3/users/glance => generated 84 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:38:26.912052 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e060ea-99df-43e8-ac8f-add11694127e None None] REQUEST_METHOD: `POST` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:26.913449 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e060ea-99df-43e8-ac8f-add11694127e None None] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:26.913449 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e060ea-99df-43e8-ac8f-add11694127e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:26.933481 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.auth.core [None req-96e060ea-99df-43e8-ac8f-add11694127e None None] MFA Rules not processed for user `e5ef88cc058f425b882bcb87a1e1e75c`. Rule list: `[]` (Enabled: `True`). {{(pid=87055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:38:26.934761 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.fernet_utils [None req-96e060ea-99df-43e8-ac8f-add11694127e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:38:26.940085 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11282822-34ca-40ea-bd39-6f69630fec21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:26.940818 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11282822-34ca-40ea-bd39-6f69630fec21 None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:26.941109 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11282822-34ca-40ea-bd39-6f69630fec21 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:26.941386 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11282822-34ca-40ea-bd39-6f69630fec21 None admin] PATH_INFO: `/v3/roles` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:26.942123 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11282822-34ca-40ea-bd39-6f69630fec21 None admin] RBAC: Adding query filter params (name=service) {{(pid=87056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:38:26.942463 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11282822-34ca-40ea-bd39-6f69630fec21 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:38:26.943908 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11282822-34ca-40ea-bd39-6f69630fec21 None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:38:26.953062 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 252/492] 10.222.0.93 () {56 vars in 1103 bytes} [Tue Jul 26 14:38:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:38:26.956652 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c03247-f11f-46f7-b463-84f748926c05 None None] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:26.956994 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c03247-f11f-46f7-b463-84f748926c05 None None] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:26.957229 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c03247-f11f-46f7-b463-84f748926c05 None None] PATH_INFO: `/` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:26.959095 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 253/493] 10.222.0.93 () {54 vars in 926 bytes} [Tue Jul 26 14:38:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:38:26.960503 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c03247-f11f-46f7-b463-84f748926c05 None None] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:26.982576 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:38:27.021439 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 241/494] 10.222.0.93 () {58 vars in 1023 bytes} [Tue Jul 26 14:38:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 14:38:27.022936 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e060ea-99df-43e8-ac8f-add11694127e None None] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:27.101391 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c03247-f11f-46f7-b463-84f748926c05 None None] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:27.143648 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91144b48-550a-4f9c-ad0d-42dc5b58c6c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:27.144311 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91144b48-550a-4f9c-ad0d-42dc5b58c6c5 None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:27.144599 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91144b48-550a-4f9c-ad0d-42dc5b58c6c5 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:27.144876 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91144b48-550a-4f9c-ad0d-42dc5b58c6c5 None admin] PATH_INFO: `/v3/users` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:27.145704 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91144b48-550a-4f9c-ad0d-42dc5b58c6c5 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=87056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:38:27.146011 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91144b48-550a-4f9c-ad0d-42dc5b58c6c5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:38:27.146125 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e060ea-99df-43e8-ac8f-add11694127e None None] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:27.148216 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91144b48-550a-4f9c-ad0d-42dc5b58c6c5 None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:38:27.161367 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:38:27.188986 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f2b59d-f652-4133-9fa0-d7ad75ca1e86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:27.189619 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 254/495] 10.222.0.93 () {56 vars in 1137 bytes} [Tue Jul 26 14:38:26 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:38:27.189733 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f2b59d-f652-4133-9fa0-d7ad75ca1e86 None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:27.195360 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f2b59d-f652-4133-9fa0-d7ad75ca1e86 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:27.195360 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f2b59d-f652-4133-9fa0-d7ad75ca1e86 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:27.195662 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab13db87-8434-4610-b79b-0f960ce7adbf None None] REQUEST_METHOD: `POST` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:27.195662 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab13db87-8434-4610-b79b-0f960ce7adbf None None] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:27.195662 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab13db87-8434-4610-b79b-0f960ce7adbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:27.207951 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f2b59d-f652-4133-9fa0-d7ad75ca1e86 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:38:27.209610 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f2b59d-f652-4133-9fa0-d7ad75ca1e86 None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:38:27.212894 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.auth.core [None req-ab13db87-8434-4610-b79b-0f960ce7adbf None None] MFA Rules not processed for user `e5ef88cc058f425b882bcb87a1e1e75c`. Rule list: `[]` (Enabled: `True`). {{(pid=87056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:38:27.214140 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.fernet_utils [None req-ab13db87-8434-4610-b79b-0f960ce7adbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:38:27.227293 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application [None req-f0f2b59d-f652-4133-9fa0-d7ad75ca1e86 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:38:27.227293 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:38:27.227293 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:38:27.227293 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:38:27.227293 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:38:27.227293 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:38:27.227293 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:38:27.227293 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:38:27.227293 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:38:27.227293 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:38:27.227293 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:38:27.227293 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:38:27.227293 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 14:38:27.227293 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 14:38:27.227293 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 14:38:27.228253 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 14:38:27.228253 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:38:27.228253 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:38:27.228253 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:38:27.228253 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:38:27.228253 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:38:27.228253 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:38:27.228253 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:38:27.228253 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application with Lock( Jul 26 14:38:27.228253 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:38:27.228253 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:38:27.228253 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:38:27.228253 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:38:27.228253 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:38:27.228253 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:38:27.228253 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:38:27.228253 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:38:27.229103 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 14:38:27.229103 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 14:38:27.229103 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:38:27.229103 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Jul 26 14:38:27.229103 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 242/496] 10.222.0.93 () {56 vars in 1108 bytes} [Tue Jul 26 14:38:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:38:27.229804 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f2b59d-f652-4133-9fa0-d7ad75ca1e86 None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:27.298981 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 255/497] 10.222.0.93 () {58 vars in 1023 bytes} [Tue Jul 26 14:38:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 14:38:27.299898 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab13db87-8434-4610-b79b-0f960ce7adbf None None] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:27.302632 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:38:27.361290 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f2b59d-f652-4133-9fa0-d7ad75ca1e86 None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:27.400221 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ae7bcb-e024-4b4a-8bd3-aa9211bcc9c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:27.400806 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ae7bcb-e024-4b4a-8bd3-aa9211bcc9c7 None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:27.401095 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ae7bcb-e024-4b4a-8bd3-aa9211bcc9c7 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:27.401375 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ae7bcb-e024-4b4a-8bd3-aa9211bcc9c7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:27.414487 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ae7bcb-e024-4b4a-8bd3-aa9211bcc9c7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 14:38:27.420151 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application [None req-97ae7bcb-e024-4b4a-8bd3-aa9211bcc9c7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 26 14:38:27.420151 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:38:27.420151 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:38:27.420151 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:38:27.420151 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:38:27.420151 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:38:27.420151 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:38:27.420151 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:38:27.420151 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:38:27.420151 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:38:27.420151 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:38:27.420151 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:38:27.420151 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 14:38:27.420151 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 14:38:27.420151 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 14:38:27.420151 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 14:38:27.421589 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 14:38:27.421589 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 14:38:27.421589 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 14:38:27.421589 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 14:38:27.421589 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:38:27.421589 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:38:27.421589 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:38:27.421589 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:38:27.421589 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:38:27.421589 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:38:27.421589 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:38:27.421589 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application with Lock( Jul 26 14:38:27.421589 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:38:27.421589 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:38:27.421589 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:38:27.421589 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:38:27.422475 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:38:27.422475 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:38:27.422475 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:38:27.422475 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:38:27.422475 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 14:38:27.422475 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 14:38:27.422475 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 14:38:27.422475 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 14:38:27.422475 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 14:38:27.422475 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 14:38:27.422475 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 26 14:38:27.422475 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Jul 26 14:38:27.422475 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 243/498] 10.222.0.93 () {56 vars in 1102 bytes} [Tue Jul 26 14:38:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:38:27.422475 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ae7bcb-e024-4b4a-8bd3-aa9211bcc9c7 None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:27.439532 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab13db87-8434-4610-b79b-0f960ce7adbf None None] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:27.467853 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:38:27.502733 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63f45e7-6088-49ba-b78a-4112b16bb862 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:27.503763 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63f45e7-6088-49ba-b78a-4112b16bb862 None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:27.504226 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63f45e7-6088-49ba-b78a-4112b16bb862 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:27.504693 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63f45e7-6088-49ba-b78a-4112b16bb862 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:27.589765 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ae7bcb-e024-4b4a-8bd3-aa9211bcc9c7 None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:27.603558 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63f45e7-6088-49ba-b78a-4112b16bb862 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:38:27.605142 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63f45e7-6088-49ba-b78a-4112b16bb862 None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:38:27.608070 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:38:27.656492 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47ee054-a0f8-4ead-b97b-d2b4058a1257 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:27.657717 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47ee054-a0f8-4ead-b97b-d2b4058a1257 None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:27.658205 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47ee054-a0f8-4ead-b97b-d2b4058a1257 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:27.658725 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47ee054-a0f8-4ead-b97b-d2b4058a1257 None admin] PATH_INFO: `/v3/domains` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:27.660019 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47ee054-a0f8-4ead-b97b-d2b4058a1257 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:38:27.660533 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47ee054-a0f8-4ead-b97b-d2b4058a1257 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:38:27.663256 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47ee054-a0f8-4ead-b97b-d2b4058a1257 None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:38:27.688668 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 244/499] 10.222.0.93 () {56 vars in 1109 bytes} [Tue Jul 26 14:38:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:38:27.688668 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47ee054-a0f8-4ead-b97b-d2b4058a1257 None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:27.750627 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 256/500] 10.222.0.93 () {58 vars in 1282 bytes} [Tue Jul 26 14:38:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 451 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 14:38:27.751667 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63f45e7-6088-49ba-b78a-4112b16bb862 None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:27.857177 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:38:27.883038 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47ee054-a0f8-4ead-b97b-d2b4058a1257 None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:27.890219 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63f45e7-6088-49ba-b78a-4112b16bb862 None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:27.893084 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:38:27.935805 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd876f1-9651-43b1-a04b-eee2b5b5efdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:27.936351 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd876f1-9651-43b1-a04b-eee2b5b5efdc None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:27.936634 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd876f1-9651-43b1-a04b-eee2b5b5efdc None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:27.936738 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47674c0a-f36e-4494-898b-a0744639e834 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:27.936912 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd876f1-9651-43b1-a04b-eee2b5b5efdc None admin] PATH_INFO: `/v3/roles` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:27.937642 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd876f1-9651-43b1-a04b-eee2b5b5efdc None admin] RBAC: Adding query filter params (name=service) {{(pid=87056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:38:27.937729 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47674c0a-f36e-4494-898b-a0744639e834 None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:27.937953 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd876f1-9651-43b1-a04b-eee2b5b5efdc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:38:27.938200 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47674c0a-f36e-4494-898b-a0744639e834 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:27.938752 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47674c0a-f36e-4494-898b-a0744639e834 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:27.939484 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd876f1-9651-43b1-a04b-eee2b5b5efdc None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:38:27.949277 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 257/501] 10.222.0.93 () {56 vars in 1103 bytes} [Tue Jul 26 14:38:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:38:27.950158 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd876f1-9651-43b1-a04b-eee2b5b5efdc None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:27.962499 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47674c0a-f36e-4494-898b-a0744639e834 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:38:27.965405 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47674c0a-f36e-4494-898b-a0744639e834 None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:38:27.987019 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application [None req-47674c0a-f36e-4494-898b-a0744639e834 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:38:27.987019 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:38:27.987019 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:38:27.987019 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:38:27.987019 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:38:27.987019 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:38:27.987019 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:38:27.987019 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:38:27.987019 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:38:27.987019 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:38:27.987019 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:38:27.987019 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:38:27.987019 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 14:38:27.987019 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 14:38:27.987019 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 14:38:27.988535 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 14:38:27.988535 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:38:27.988535 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:38:27.988535 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:38:27.988535 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:38:27.988535 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:38:27.988535 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:38:27.988535 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:38:27.988535 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application with Lock( Jul 26 14:38:27.988535 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:38:27.988535 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:38:27.988535 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:38:27.988535 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:38:27.988535 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:38:27.988535 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:38:27.988535 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:38:27.988535 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:38:27.990502 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 14:38:27.990502 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 14:38:27.990502 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:38:27.990502 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Jul 26 14:38:27.990502 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 245/502] 10.222.0.93 () {56 vars in 1108 bytes} [Tue Jul 26 14:38:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:38:27.990502 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47674c0a-f36e-4494-898b-a0744639e834 None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:28.089047 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd876f1-9651-43b1-a04b-eee2b5b5efdc None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:28.128373 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d662284f-f4d5-4fce-b485-038624d9fc54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:28.129038 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d662284f-f4d5-4fce-b485-038624d9fc54 None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:28.129380 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d662284f-f4d5-4fce-b485-038624d9fc54 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:28.129667 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d662284f-f4d5-4fce-b485-038624d9fc54 None admin] PATH_INFO: `/v3/users/nova` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:28.132684 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47674c0a-f36e-4494-898b-a0744639e834 None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:28.139392 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d662284f-f4d5-4fce-b485-038624d9fc54 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:38:28.140900 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d662284f-f4d5-4fce-b485-038624d9fc54 None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:38:28.155748 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application [None req-d662284f-f4d5-4fce-b485-038624d9fc54 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 26 14:38:28.155748 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:38:28.155748 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:38:28.155748 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:38:28.155748 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:38:28.155748 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:38:28.155748 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:38:28.155748 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:38:28.155748 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:38:28.155748 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:38:28.155748 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:38:28.155748 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:38:28.155748 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 14:38:28.155748 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 14:38:28.155748 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 14:38:28.155748 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 14:38:28.157946 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:38:28.157946 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:38:28.157946 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 14:38:28.157946 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 14:38:28.157946 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 14:38:28.157946 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 14:38:28.157946 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:38:28.157946 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:38:28.157946 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:38:28.157946 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:38:28.157946 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:38:28.157946 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application with Lock( Jul 26 14:38:28.157946 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:38:28.157946 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:38:28.157946 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:38:28.157946 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:38:28.157946 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:38:28.157946 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:38:28.159977 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:38:28.159977 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:38:28.159977 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 14:38:28.159977 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 14:38:28.159977 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 14:38:28.159977 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 14:38:28.159977 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 14:38:28.159977 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 14:38:28.159977 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 26 14:38:28.159977 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Jul 26 14:38:28.159977 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 258/503] 10.222.0.93 () {56 vars in 1093 bytes} [Tue Jul 26 14:38:27 2022] GET /identity/v3/users/nova => generated 82 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:38:28.159977 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcd143b-6b68-4bc8-8668-cd52beb30837 None None] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:28.159977 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcd143b-6b68-4bc8-8668-cd52beb30837 None None] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:28.161432 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcd143b-6b68-4bc8-8668-cd52beb30837 None None] PATH_INFO: `/` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:28.162465 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 259/504] 10.222.0.93 () {54 vars in 926 bytes} [Tue Jul 26 14:38:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:38:28.164284 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcd143b-6b68-4bc8-8668-cd52beb30837 None None] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:28.186312 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4aab218-820d-4e04-a089-190ed45cbc4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:28.187301 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4aab218-820d-4e04-a089-190ed45cbc4a None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:28.187585 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4aab218-820d-4e04-a089-190ed45cbc4a None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:28.187868 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4aab218-820d-4e04-a089-190ed45cbc4a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:28.190341 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:38:28.202102 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4aab218-820d-4e04-a089-190ed45cbc4a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:38:28.205047 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4aab218-820d-4e04-a089-190ed45cbc4a None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:38:28.208928 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:38:28.224462 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application [None req-b4aab218-820d-4e04-a089-190ed45cbc4a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:38:28.224462 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:38:28.224462 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:38:28.224462 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:38:28.224462 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:38:28.224462 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:38:28.224462 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:38:28.224462 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:38:28.224462 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:38:28.224462 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:38:28.224462 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:38:28.224462 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:38:28.224462 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 14:38:28.224462 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 14:38:28.224462 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 14:38:28.226461 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 14:38:28.226461 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:38:28.226461 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:38:28.226461 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:38:28.226461 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:38:28.226461 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:38:28.226461 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:38:28.226461 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:38:28.226461 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application with Lock( Jul 26 14:38:28.226461 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:38:28.226461 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:38:28.226461 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:38:28.226461 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:38:28.226461 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:38:28.226461 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:38:28.226461 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:38:28.226461 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:38:28.228668 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 14:38:28.228668 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 14:38:28.228668 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:38:28.228668 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Jul 26 14:38:28.228668 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 246/505] 10.222.0.93 () {56 vars in 1108 bytes} [Tue Jul 26 14:38:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:38:28.228668 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4aab218-820d-4e04-a089-190ed45cbc4a None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:28.306642 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcd143b-6b68-4bc8-8668-cd52beb30837 None None] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:28.348959 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3779c06-83a8-4e58-91b9-b61883d2b240 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:28.349625 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3779c06-83a8-4e58-91b9-b61883d2b240 None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:28.349909 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3779c06-83a8-4e58-91b9-b61883d2b240 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:28.350293 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3779c06-83a8-4e58-91b9-b61883d2b240 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:28.362189 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3779c06-83a8-4e58-91b9-b61883d2b240 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:38:28.363706 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3779c06-83a8-4e58-91b9-b61883d2b240 None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:38:28.383051 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application [None req-f3779c06-83a8-4e58-91b9-b61883d2b240 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:38:28.383051 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:38:28.383051 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:38:28.383051 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:38:28.383051 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:38:28.383051 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:38:28.383051 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:38:28.383051 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:38:28.383051 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:38:28.383051 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:38:28.383051 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:38:28.383051 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:38:28.383051 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 14:38:28.383051 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 14:38:28.383051 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 14:38:28.391269 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 14:38:28.391269 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:38:28.391269 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:38:28.391269 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:38:28.391269 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:38:28.391269 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:38:28.391269 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:38:28.391269 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:38:28.391269 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application with Lock( Jul 26 14:38:28.391269 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:38:28.391269 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:38:28.391269 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:38:28.391269 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:38:28.391269 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:38:28.391269 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:38:28.391269 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:38:28.391269 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:38:28.392219 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 14:38:28.392219 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 14:38:28.392219 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:38:28.392219 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Jul 26 14:38:28.392219 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 260/506] 10.222.0.93 () {56 vars in 1108 bytes} [Tue Jul 26 14:38:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:38:28.392219 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3779c06-83a8-4e58-91b9-b61883d2b240 None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:28.409531 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4aab218-820d-4e04-a089-190ed45cbc4a None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:28.462805 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb83d5e-8b58-4765-a600-13321f93207c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:28.463347 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb83d5e-8b58-4765-a600-13321f93207c None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:28.463630 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb83d5e-8b58-4765-a600-13321f93207c None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:28.463914 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb83d5e-8b58-4765-a600-13321f93207c None admin] PATH_INFO: `/v3/domains` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:28.464643 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb83d5e-8b58-4765-a600-13321f93207c None admin] RBAC: Adding query filter params (name=Default) {{(pid=87055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:38:28.464952 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb83d5e-8b58-4765-a600-13321f93207c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:38:28.466441 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb83d5e-8b58-4765-a600-13321f93207c None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:38:28.481834 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 247/507] 10.222.0.93 () {56 vars in 1109 bytes} [Tue Jul 26 14:38:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:38:28.483191 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222ea40e-d0ef-421c-93a2-d42c32bb8ef0 None None] REQUEST_METHOD: `POST` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:28.483549 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222ea40e-d0ef-421c-93a2-d42c32bb8ef0 None None] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:28.483745 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222ea40e-d0ef-421c-93a2-d42c32bb8ef0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:28.484362 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:38:28.503798 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.auth.core [None req-222ea40e-d0ef-421c-93a2-d42c32bb8ef0 None None] MFA Rules not processed for user `e5ef88cc058f425b882bcb87a1e1e75c`. Rule list: `[]` (Enabled: `True`). {{(pid=87055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:38:28.505061 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.fernet_utils [None req-222ea40e-d0ef-421c-93a2-d42c32bb8ef0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:38:28.518164 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3779c06-83a8-4e58-91b9-b61883d2b240 None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:28.575190 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:38:28.577457 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fa4581-a66d-4fcd-9e7c-6c6c0ddebbca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:28.578536 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fa4581-a66d-4fcd-9e7c-6c6c0ddebbca None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:28.579006 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fa4581-a66d-4fcd-9e7c-6c6c0ddebbca None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:28.579454 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fa4581-a66d-4fcd-9e7c-6c6c0ddebbca None admin] PATH_INFO: `/v3/users` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:28.580875 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fa4581-a66d-4fcd-9e7c-6c6c0ddebbca None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:38:28.581391 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fa4581-a66d-4fcd-9e7c-6c6c0ddebbca None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:38:28.583931 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fa4581-a66d-4fcd-9e7c-6c6c0ddebbca None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:38:28.611325 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 261/508] 10.222.0.93 () {56 vars in 1133 bytes} [Tue Jul 26 14:38:28 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:38:28.612053 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fa4581-a66d-4fcd-9e7c-6c6c0ddebbca None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:28.623248 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 248/509] 10.222.0.93 () {58 vars in 1023 bytes} [Tue Jul 26 14:38:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 14:38:28.625181 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222ea40e-d0ef-421c-93a2-d42c32bb8ef0 None None] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:28.751874 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fa4581-a66d-4fcd-9e7c-6c6c0ddebbca None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:28.774612 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222ea40e-d0ef-421c-93a2-d42c32bb8ef0 None None] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:28.804346 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34269034-9f74-4184-81c8-4b02123a410f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:28.805382 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34269034-9f74-4184-81c8-4b02123a410f None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:28.805868 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34269034-9f74-4184-81c8-4b02123a410f None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:28.806385 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34269034-9f74-4184-81c8-4b02123a410f None admin] PATH_INFO: `/v3/domains` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:28.807596 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34269034-9f74-4184-81c8-4b02123a410f None admin] RBAC: Adding query filter params (name=Default) {{(pid=87056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:38:28.808120 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34269034-9f74-4184-81c8-4b02123a410f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:38:28.810437 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34269034-9f74-4184-81c8-4b02123a410f None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:38:28.812944 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:38:28.813237 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05804a8-c9ec-4d30-89f5-426e435beb83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:28.813891 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05804a8-c9ec-4d30-89f5-426e435beb83 None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:28.814172 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05804a8-c9ec-4d30-89f5-426e435beb83 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:28.814486 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05804a8-c9ec-4d30-89f5-426e435beb83 None admin] PATH_INFO: `/v3/domains` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:28.815208 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05804a8-c9ec-4d30-89f5-426e435beb83 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:38:28.815544 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05804a8-c9ec-4d30-89f5-426e435beb83 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:38:28.816962 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05804a8-c9ec-4d30-89f5-426e435beb83 None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:38:28.831446 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 249/510] 10.222.0.93 () {56 vars in 1109 bytes} [Tue Jul 26 14:38:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:38:28.832321 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05804a8-c9ec-4d30-89f5-426e435beb83 None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:28.836018 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 262/511] 10.222.0.93 () {56 vars in 1109 bytes} [Tue Jul 26 14:38:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:38:28.839214 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34269034-9f74-4184-81c8-4b02123a410f None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:28.874704 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:38:28.961999 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05804a8-c9ec-4d30-89f5-426e435beb83 None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:28.985273 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34269034-9f74-4184-81c8-4b02123a410f None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:29.002620 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeeee14a-f91f-42bf-b16f-8c059eb8f336 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:29.003150 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeeee14a-f91f-42bf-b16f-8c059eb8f336 None admin] REQUEST_METHOD: `POST` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:29.003434 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeeee14a-f91f-42bf-b16f-8c059eb8f336 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:29.003709 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeeee14a-f91f-42bf-b16f-8c059eb8f336 None admin] PATH_INFO: `/v3/users` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:29.004425 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeeee14a-f91f-42bf-b16f-8c059eb8f336 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:38:29.005925 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeeee14a-f91f-42bf-b16f-8c059eb8f336 None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:38:29.030328 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1f2405-d049-4e43-a306-1207385fc6a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:29.031084 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1f2405-d049-4e43-a306-1207385fc6a1 None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:29.031446 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1f2405-d049-4e43-a306-1207385fc6a1 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:29.031992 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1f2405-d049-4e43-a306-1207385fc6a1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:29.104005 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:38:29.113934 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1f2405-d049-4e43-a306-1207385fc6a1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:38:29.117129 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1f2405-d049-4e43-a306-1207385fc6a1 None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:38:29.118397 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 250/512] 10.222.0.93 () {60 vars in 1132 bytes} [Tue Jul 26 14:38:28 2022] POST /identity/v3/users => generated 247 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 14:38:29.119758 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeeee14a-f91f-42bf-b16f-8c059eb8f336 None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:29.297753 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:38:29.309041 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 263/513] 10.222.0.93 () {58 vars in 1282 bytes} [Tue Jul 26 14:38:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 472 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 14:38:29.310743 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1f2405-d049-4e43-a306-1207385fc6a1 None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:29.320609 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeeee14a-f91f-42bf-b16f-8c059eb8f336 None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:29.377198 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f981f52-8768-4d06-be91-41f76138f87e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:29.378309 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f981f52-8768-4d06-be91-41f76138f87e None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:29.378850 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f981f52-8768-4d06-be91-41f76138f87e None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:29.379306 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f981f52-8768-4d06-be91-41f76138f87e None admin] PATH_INFO: `/v3/roles/service` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:29.400500 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f981f52-8768-4d06-be91-41f76138f87e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 14:38:29.411003 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application [None req-1f981f52-8768-4d06-be91-41f76138f87e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 26 14:38:29.411003 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:38:29.411003 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:38:29.411003 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:38:29.411003 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:38:29.411003 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:38:29.411003 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:38:29.411003 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:38:29.411003 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:38:29.411003 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:38:29.411003 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:38:29.411003 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:38:29.411003 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 14:38:29.411003 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 14:38:29.411003 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 14:38:29.411003 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 14:38:29.412442 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 14:38:29.412442 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 14:38:29.412442 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 14:38:29.412442 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 14:38:29.412442 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:38:29.412442 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:38:29.412442 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:38:29.412442 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:38:29.412442 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:38:29.412442 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:38:29.412442 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:38:29.412442 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application with Lock( Jul 26 14:38:29.412442 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:38:29.412442 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:38:29.412442 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:38:29.412442 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:38:29.413972 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:38:29.413972 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:38:29.413972 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:38:29.413972 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:38:29.413972 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 14:38:29.413972 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 14:38:29.413972 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 14:38:29.413972 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 14:38:29.413972 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 14:38:29.413972 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 14:38:29.413972 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 26 14:38:29.413972 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Jul 26 14:38:29.420196 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 251/514] 10.222.0.93 () {56 vars in 1102 bytes} [Tue Jul 26 14:38:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:38:29.420196 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f981f52-8768-4d06-be91-41f76138f87e None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:29.501247 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:38:29.513550 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1f2405-d049-4e43-a306-1207385fc6a1 None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:29.565337 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0eeb132-bdc2-48a8-8e2c-d23f8979b6d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:29.566101 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0eeb132-bdc2-48a8-8e2c-d23f8979b6d4 None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:29.566611 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0eeb132-bdc2-48a8-8e2c-d23f8979b6d4 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:29.567075 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0eeb132-bdc2-48a8-8e2c-d23f8979b6d4 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:29.577024 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0eeb132-bdc2-48a8-8e2c-d23f8979b6d4 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:38:29.579112 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0eeb132-bdc2-48a8-8e2c-d23f8979b6d4 None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:38:29.595135 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application [None req-b0eeb132-bdc2-48a8-8e2c-d23f8979b6d4 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 26 14:38:29.595135 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:38:29.595135 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:38:29.595135 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:38:29.595135 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:38:29.595135 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:38:29.595135 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:38:29.595135 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:38:29.595135 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:38:29.595135 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:38:29.595135 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:38:29.595135 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:38:29.595135 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 14:38:29.595135 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 14:38:29.595135 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 14:38:29.595135 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 14:38:29.596897 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:38:29.596897 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:38:29.596897 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 14:38:29.596897 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 14:38:29.596897 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 14:38:29.596897 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 14:38:29.596897 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:38:29.596897 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:38:29.596897 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:38:29.596897 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:38:29.596897 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:38:29.596897 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application with Lock( Jul 26 14:38:29.596897 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:38:29.596897 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:38:29.596897 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:38:29.596897 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:38:29.596897 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:38:29.596897 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:38:29.598654 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:38:29.598654 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:38:29.598654 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 14:38:29.598654 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 14:38:29.598654 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 14:38:29.598654 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 14:38:29.598654 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 14:38:29.598654 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 14:38:29.598654 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 26 14:38:29.598654 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Jul 26 14:38:29.599192 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f981f52-8768-4d06-be91-41f76138f87e None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:29.602291 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 264/515] 10.222.0.93 () {56 vars in 1099 bytes} [Tue Jul 26 14:38:29 2022] GET /identity/v3/users/cinder => generated 84 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:38:29.603019 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0eeb132-bdc2-48a8-8e2c-d23f8979b6d4 None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:29.653884 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb38c9c-3d77-4f8a-9387-814fcbba303b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:29.654596 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb38c9c-3d77-4f8a-9387-814fcbba303b None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:29.654898 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb38c9c-3d77-4f8a-9387-814fcbba303b None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:29.655166 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb38c9c-3d77-4f8a-9387-814fcbba303b None admin] PATH_INFO: `/v3/projects/service` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:29.665581 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb38c9c-3d77-4f8a-9387-814fcbba303b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:38:29.666465 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb38c9c-3d77-4f8a-9387-814fcbba303b None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:38:29.681017 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application [None req-ceb38c9c-3d77-4f8a-9387-814fcbba303b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 14:38:29.681017 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:38:29.681017 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:38:29.681017 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:38:29.681017 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:38:29.681017 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:38:29.681017 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:38:29.681017 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:38:29.681017 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:38:29.681017 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:38:29.681017 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:38:29.681017 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:38:29.681017 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 14:38:29.681017 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 14:38:29.681017 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 14:38:29.682796 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 14:38:29.682796 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:38:29.682796 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:38:29.682796 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:38:29.682796 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:38:29.682796 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:38:29.682796 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:38:29.682796 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:38:29.682796 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application with Lock( Jul 26 14:38:29.682796 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:38:29.682796 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:38:29.682796 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:38:29.682796 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:38:29.682796 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:38:29.682796 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:38:29.682796 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:38:29.682796 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:38:29.684620 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 14:38:29.684620 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 14:38:29.684620 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 14:38:29.684620 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 14:38:29.684620 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 14:38:29.684620 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 14:38:29.684620 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 14:38:29.684620 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Jul 26 14:38:29.684620 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 252/516] 10.222.0.93 () {56 vars in 1111 bytes} [Tue Jul 26 14:38:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:38:29.684620 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb38c9c-3d77-4f8a-9387-814fcbba303b None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:29.718496 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:38:29.808355 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0eeb132-bdc2-48a8-8e2c-d23f8979b6d4 None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:29.852267 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb38c9c-3d77-4f8a-9387-814fcbba303b None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:29.863326 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd765f7-25d7-4121-a300-a5116c261242 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:29.864054 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd765f7-25d7-4121-a300-a5116c261242 None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:29.864397 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd765f7-25d7-4121-a300-a5116c261242 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:29.864681 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd765f7-25d7-4121-a300-a5116c261242 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:29.878395 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd765f7-25d7-4121-a300-a5116c261242 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:38:29.880051 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd765f7-25d7-4121-a300-a5116c261242 None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:38:29.899901 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application [None req-2dd765f7-25d7-4121-a300-a5116c261242 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:38:29.899901 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:38:29.899901 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:38:29.899901 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:38:29.899901 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:38:29.899901 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:38:29.899901 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:38:29.899901 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:38:29.899901 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:38:29.899901 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:38:29.899901 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:38:29.899901 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:38:29.899901 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 14:38:29.899901 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 14:38:29.899901 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 14:38:29.901575 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 14:38:29.901575 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:38:29.901575 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:38:29.901575 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:38:29.901575 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:38:29.901575 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:38:29.901575 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:38:29.901575 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:38:29.901575 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application with Lock( Jul 26 14:38:29.901575 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:38:29.901575 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:38:29.901575 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:38:29.901575 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:38:29.901575 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:38:29.901575 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:38:29.901575 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:38:29.901575 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:38:29.903758 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 14:38:29.903758 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 14:38:29.903758 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:38:29.903758 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Jul 26 14:38:29.903758 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 265/517] 10.222.0.93 () {56 vars in 1108 bytes} [Tue Jul 26 14:38:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:38:29.903758 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd765f7-25d7-4121-a300-a5116c261242 None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:29.925436 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:38:29.930299 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64734cf-5a4b-4a49-87ec-5088ef2f701d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:29.931382 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64734cf-5a4b-4a49-87ec-5088ef2f701d None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:29.931865 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64734cf-5a4b-4a49-87ec-5088ef2f701d None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:29.932338 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64734cf-5a4b-4a49-87ec-5088ef2f701d None admin] PATH_INFO: `/v3/roles` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:29.933747 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64734cf-5a4b-4a49-87ec-5088ef2f701d None admin] RBAC: Adding query filter params (name=service) {{(pid=87055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:38:29.934295 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64734cf-5a4b-4a49-87ec-5088ef2f701d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:38:29.936874 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64734cf-5a4b-4a49-87ec-5088ef2f701d None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:38:29.953386 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 253/518] 10.222.0.93 () {56 vars in 1103 bytes} [Tue Jul 26 14:38:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:38:29.954919 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64734cf-5a4b-4a49-87ec-5088ef2f701d None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:30.084701 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:38:30.123033 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd765f7-25d7-4121-a300-a5116c261242 None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:30.129626 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64734cf-5a4b-4a49-87ec-5088ef2f701d None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:30.170715 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cb7740-7fed-4b13-9810-569f28f08bb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:30.171532 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cb7740-7fed-4b13-9810-569f28f08bb2 None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:30.171995 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cb7740-7fed-4b13-9810-569f28f08bb2 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:30.172403 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cb7740-7fed-4b13-9810-569f28f08bb2 None admin] PATH_INFO: `/v3/users` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:30.173755 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cb7740-7fed-4b13-9810-569f28f08bb2 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=87056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:38:30.174305 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cb7740-7fed-4b13-9810-569f28f08bb2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:38:30.175930 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cb7740-7fed-4b13-9810-569f28f08bb2 None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:38:30.206684 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 266/519] 10.222.0.93 () {56 vars in 1137 bytes} [Tue Jul 26 14:38:29 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:38:30.206684 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cb7740-7fed-4b13-9810-569f28f08bb2 None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:30.209948 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4aa107e-248b-41e5-b3fb-9a2eace4cc28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:30.212928 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4aa107e-248b-41e5-b3fb-9a2eace4cc28 None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:30.213471 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4aa107e-248b-41e5-b3fb-9a2eace4cc28 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:30.213930 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4aa107e-248b-41e5-b3fb-9a2eace4cc28 None admin] PATH_INFO: `/v3/projects` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:30.215288 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4aa107e-248b-41e5-b3fb-9a2eace4cc28 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:38:30.215876 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4aa107e-248b-41e5-b3fb-9a2eace4cc28 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:38:30.218501 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4aa107e-248b-41e5-b3fb-9a2eace4cc28 None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:38:30.246802 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 254/520] 10.222.0.93 () {56 vars in 1148 bytes} [Tue Jul 26 14:38:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:38:30.247732 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4aa107e-248b-41e5-b3fb-9a2eace4cc28 None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:30.336265 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:38:30.400710 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cb7740-7fed-4b13-9810-569f28f08bb2 None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:30.440185 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4aa107e-248b-41e5-b3fb-9a2eace4cc28 None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:30.453002 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a020788-ed87-4c51-a260-6c478faa0290 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:30.453794 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a020788-ed87-4c51-a260-6c478faa0290 None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:30.454200 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a020788-ed87-4c51-a260-6c478faa0290 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:30.454655 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a020788-ed87-4c51-a260-6c478faa0290 None admin] PATH_INFO: `/v3/domains` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:30.455512 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a020788-ed87-4c51-a260-6c478faa0290 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:38:30.456614 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a020788-ed87-4c51-a260-6c478faa0290 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:38:30.457942 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a020788-ed87-4c51-a260-6c478faa0290 None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:38:30.482611 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 267/521] 10.222.0.93 () {56 vars in 1109 bytes} [Tue Jul 26 14:38:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:38:30.482611 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a020788-ed87-4c51-a260-6c478faa0290 None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:30.519214 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1144360-438c-4fee-a5dc-ac24415048ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:30.520433 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1144360-438c-4fee-a5dc-ac24415048ff None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:30.521045 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1144360-438c-4fee-a5dc-ac24415048ff None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:30.521607 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1144360-438c-4fee-a5dc-ac24415048ff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:30.526630 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:38:30.544213 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1144360-438c-4fee-a5dc-ac24415048ff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:38:30.547125 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1144360-438c-4fee-a5dc-ac24415048ff None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:38:30.578061 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application [None req-b1144360-438c-4fee-a5dc-ac24415048ff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:38:30.578061 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:38:30.578061 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:38:30.578061 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:38:30.578061 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:38:30.578061 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:38:30.578061 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:38:30.578061 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:38:30.578061 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:38:30.578061 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:38:30.578061 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:38:30.578061 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:38:30.578061 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 14:38:30.578061 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 14:38:30.578061 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 14:38:30.579269 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 14:38:30.579269 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:38:30.579269 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:38:30.579269 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:38:30.579269 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:38:30.579269 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:38:30.579269 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:38:30.579269 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:38:30.579269 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application with Lock( Jul 26 14:38:30.579269 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:38:30.579269 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:38:30.579269 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:38:30.579269 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:38:30.579269 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:38:30.579269 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:38:30.579269 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:38:30.579269 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:38:30.580383 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 14:38:30.580383 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 14:38:30.580383 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:38:30.580383 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Jul 26 14:38:30.587879 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 255/522] 10.222.0.93 () {56 vars in 1108 bytes} [Tue Jul 26 14:38:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 335 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:38:30.587879 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1144360-438c-4fee-a5dc-ac24415048ff None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:30.637833 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a020788-ed87-4c51-a260-6c478faa0290 None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:30.686021 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:38:30.709347 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e2ff73-f417-4446-bd88-1a2a22a9c3b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:30.710905 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e2ff73-f417-4446-bd88-1a2a22a9c3b8 None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:30.711261 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e2ff73-f417-4446-bd88-1a2a22a9c3b8 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:30.711554 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e2ff73-f417-4446-bd88-1a2a22a9c3b8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:30.757000 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1144360-438c-4fee-a5dc-ac24415048ff None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:30.812648 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77dd82a-c355-400a-9364-15489127f201 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:30.813669 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77dd82a-c355-400a-9364-15489127f201 None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:30.814109 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77dd82a-c355-400a-9364-15489127f201 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:30.814586 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77dd82a-c355-400a-9364-15489127f201 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:30.815582 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77dd82a-c355-400a-9364-15489127f201 None admin] RBAC: Adding query filter params (role.id=2e45ca312cda4bef9263725ae1c6dab7, scope.project.id=c422a2290a14424da20e2841cbc1741d, user.id=38ab40a64fb7419ebb0476e0fa09a2bb) {{(pid=87055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:38:30.816212 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77dd82a-c355-400a-9364-15489127f201 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:38:30.818279 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77dd82a-c355-400a-9364-15489127f201 None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:38:30.821190 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e2ff73-f417-4446-bd88-1a2a22a9c3b8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:38:30.823577 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e2ff73-f417-4446-bd88-1a2a22a9c3b8 None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:38:30.826178 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 256/523] 10.222.0.93 () {56 vars in 1374 bytes} [Tue Jul 26 14:38:30 2022] GET /identity/v3/role_assignments?user.id=38ab40a64fb7419ebb0476e0fa09a2bb&scope.project.id=c422a2290a14424da20e2841cbc1741d&role.id=2e45ca312cda4bef9263725ae1c6dab7 => generated 259 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:38:30.827377 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77dd82a-c355-400a-9364-15489127f201 None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:30.932275 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:38:31.041373 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77dd82a-c355-400a-9364-15489127f201 None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:31.063539 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 268/524] 10.222.0.93 () {58 vars in 1282 bytes} [Tue Jul 26 14:38:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 587 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 14:38:31.065272 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e2ff73-f417-4446-bd88-1a2a22a9c3b8 None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:31.098339 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb687f1e-1649-47aa-8acd-d8f0e7e61827 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:31.099250 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb687f1e-1649-47aa-8acd-d8f0e7e61827 None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:31.099535 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb687f1e-1649-47aa-8acd-d8f0e7e61827 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:31.099816 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb687f1e-1649-47aa-8acd-d8f0e7e61827 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:31.110128 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb687f1e-1649-47aa-8acd-d8f0e7e61827 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:38:31.112271 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb687f1e-1649-47aa-8acd-d8f0e7e61827 None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:38:31.125522 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:38:31.127553 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application [None req-cb687f1e-1649-47aa-8acd-d8f0e7e61827 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 14:38:31.127553 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:38:31.127553 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:38:31.127553 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:38:31.127553 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:38:31.127553 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:38:31.127553 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:38:31.127553 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:38:31.127553 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:38:31.127553 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:38:31.127553 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:38:31.127553 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:38:31.127553 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 14:38:31.127553 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 14:38:31.127553 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 14:38:31.129375 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 14:38:31.129375 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:38:31.129375 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:38:31.129375 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:38:31.129375 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:38:31.129375 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:38:31.129375 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:38:31.129375 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:38:31.129375 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application with Lock( Jul 26 14:38:31.129375 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:38:31.129375 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:38:31.129375 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:38:31.129375 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:38:31.129375 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:38:31.129375 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:38:31.129375 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:38:31.129375 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:38:31.131029 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 14:38:31.131029 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 14:38:31.131029 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 14:38:31.131029 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 14:38:31.131029 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 14:38:31.131029 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 14:38:31.131029 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 14:38:31.131029 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Jul 26 14:38:31.131029 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 257/525] 10.222.0.93 () {56 vars in 1111 bytes} [Tue Jul 26 14:38:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:38:31.131029 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb687f1e-1649-47aa-8acd-d8f0e7e61827 None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:31.234310 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e2ff73-f417-4446-bd88-1a2a22a9c3b8 None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:31.276728 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061562cd-b694-455d-9e05-3d72c5319417 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:31.277365 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061562cd-b694-455d-9e05-3d72c5319417 None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:31.277644 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061562cd-b694-455d-9e05-3d72c5319417 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:31.277918 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061562cd-b694-455d-9e05-3d72c5319417 None admin] PATH_INFO: `/v3/domains` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:31.278681 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061562cd-b694-455d-9e05-3d72c5319417 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:38:31.278986 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061562cd-b694-455d-9e05-3d72c5319417 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:38:31.280411 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061562cd-b694-455d-9e05-3d72c5319417 None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:38:31.294914 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 269/526] 10.222.0.93 () {56 vars in 1109 bytes} [Tue Jul 26 14:38:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:38:31.295763 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061562cd-b694-455d-9e05-3d72c5319417 None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:31.342156 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb687f1e-1649-47aa-8acd-d8f0e7e61827 None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:31.365441 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:38:31.398999 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:38:31.417054 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8561f7bd-ef07-4b84-923c-baf14e406be4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:31.418471 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061562cd-b694-455d-9e05-3d72c5319417 None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:31.418709 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8561f7bd-ef07-4b84-923c-baf14e406be4 None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:31.419409 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8561f7bd-ef07-4b84-923c-baf14e406be4 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:31.420169 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8561f7bd-ef07-4b84-923c-baf14e406be4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:31.442830 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8561f7bd-ef07-4b84-923c-baf14e406be4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:38:31.447393 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8561f7bd-ef07-4b84-923c-baf14e406be4 None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:38:31.459917 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e26a12-ac7e-4f44-ae89-7776dab55940 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:31.461371 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e26a12-ac7e-4f44-ae89-7776dab55940 None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:31.461371 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e26a12-ac7e-4f44-ae89-7776dab55940 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:31.461371 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e26a12-ac7e-4f44-ae89-7776dab55940 None admin] PATH_INFO: `/v3/projects` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:31.462014 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e26a12-ac7e-4f44-ae89-7776dab55940 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:38:31.462361 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e26a12-ac7e-4f44-ae89-7776dab55940 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:38:31.463869 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e26a12-ac7e-4f44-ae89-7776dab55940 None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:38:31.479557 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application [None req-8561f7bd-ef07-4b84-923c-baf14e406be4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:38:31.479557 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:38:31.479557 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:38:31.479557 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:38:31.479557 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:38:31.479557 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:38:31.479557 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:38:31.479557 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:38:31.479557 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:38:31.479557 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:38:31.479557 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:38:31.479557 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:38:31.479557 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 14:38:31.479557 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 14:38:31.479557 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 14:38:31.481407 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 14:38:31.481407 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:38:31.481407 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:38:31.481407 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:38:31.481407 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:38:31.481407 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:38:31.481407 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:38:31.481407 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:38:31.481407 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application with Lock( Jul 26 14:38:31.481407 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:38:31.481407 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:38:31.481407 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:38:31.481407 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:38:31.481407 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:38:31.481407 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:38:31.481407 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:38:31.481407 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:38:31.483065 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 14:38:31.483065 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 14:38:31.483065 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:38:31.483065 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Jul 26 14:38:31.485069 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 270/527] 10.222.0.93 () {56 vars in 1148 bytes} [Tue Jul 26 14:38:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:38:31.486516 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e26a12-ac7e-4f44-ae89-7776dab55940 None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:31.488222 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 258/528] 10.222.0.93 () {56 vars in 1108 bytes} [Tue Jul 26 14:38:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 359 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:38:31.495419 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8561f7bd-ef07-4b84-923c-baf14e406be4 None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:31.646509 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8561f7bd-ef07-4b84-923c-baf14e406be4 None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:31.700948 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7316ea-c625-49cd-9652-640d38fab73b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:31.701942 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7316ea-c625-49cd-9652-640d38fab73b None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:31.702437 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7316ea-c625-49cd-9652-640d38fab73b None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:31.702890 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7316ea-c625-49cd-9652-640d38fab73b None admin] PATH_INFO: `/v3/domains` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:31.703877 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7316ea-c625-49cd-9652-640d38fab73b None admin] RBAC: Adding query filter params (name=Default) {{(pid=87055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:38:31.704391 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7316ea-c625-49cd-9652-640d38fab73b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:38:31.705985 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7316ea-c625-49cd-9652-640d38fab73b None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:38:31.732738 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 259/529] 10.222.0.93 () {56 vars in 1109 bytes} [Tue Jul 26 14:38:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:38:31.732738 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7316ea-c625-49cd-9652-640d38fab73b None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:31.736600 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e26a12-ac7e-4f44-ae89-7776dab55940 None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:31.781420 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941e8bb5-0c67-4f6f-83d8-a604a01a0362 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:31.782843 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941e8bb5-0c67-4f6f-83d8-a604a01a0362 None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:31.783321 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941e8bb5-0c67-4f6f-83d8-a604a01a0362 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:31.783787 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941e8bb5-0c67-4f6f-83d8-a604a01a0362 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:31.791820 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:38:31.797616 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941e8bb5-0c67-4f6f-83d8-a604a01a0362 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:38:31.801104 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941e8bb5-0c67-4f6f-83d8-a604a01a0362 None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:38:31.826458 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application [None req-941e8bb5-0c67-4f6f-83d8-a604a01a0362 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 26 14:38:31.826458 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:38:31.826458 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:38:31.826458 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:38:31.826458 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:38:31.826458 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:38:31.826458 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:38:31.826458 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:38:31.826458 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:38:31.826458 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:38:31.826458 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:38:31.826458 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:38:31.826458 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 14:38:31.826458 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 14:38:31.826458 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 14:38:31.826458 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 14:38:31.828213 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:38:31.828213 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:38:31.828213 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 14:38:31.828213 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 14:38:31.828213 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 14:38:31.828213 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 14:38:31.828213 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:38:31.828213 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:38:31.828213 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:38:31.828213 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:38:31.828213 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:38:31.828213 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application with Lock( Jul 26 14:38:31.828213 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:38:31.828213 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:38:31.828213 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:38:31.828213 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:38:31.828213 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:38:31.828213 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:38:31.829933 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:38:31.829933 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:38:31.829933 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 14:38:31.829933 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 14:38:31.829933 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 14:38:31.829933 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 14:38:31.829933 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 14:38:31.829933 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 14:38:31.829933 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 26 14:38:31.829933 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Jul 26 14:38:31.835558 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 271/530] 10.222.0.93 () {56 vars in 1102 bytes} [Tue Jul 26 14:38:31 2022] GET /identity/v3/users/neutron => generated 85 bytes in 350 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:38:31.837446 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941e8bb5-0c67-4f6f-83d8-a604a01a0362 None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:31.845925 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:38:31.976498 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7316ea-c625-49cd-9652-640d38fab73b None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:32.050903 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3182db06-8a06-4dd2-838e-c8676d7be4ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:32.051973 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3182db06-8a06-4dd2-838e-c8676d7be4ea None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:32.053054 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3182db06-8a06-4dd2-838e-c8676d7be4ea None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:32.054611 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3182db06-8a06-4dd2-838e-c8676d7be4ea None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:32.057110 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3182db06-8a06-4dd2-838e-c8676d7be4ea None admin] RBAC: Adding query filter params (role.id=2e45ca312cda4bef9263725ae1c6dab7, scope.project.id=c422a2290a14424da20e2841cbc1741d, user.id=2e86fe36c9bf49a481c9f15ac7571b88) {{(pid=87055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:38:32.057684 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3182db06-8a06-4dd2-838e-c8676d7be4ea None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:38:32.061392 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3182db06-8a06-4dd2-838e-c8676d7be4ea None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:38:32.075856 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 260/531] 10.222.0.93 () {56 vars in 1374 bytes} [Tue Jul 26 14:38:31 2022] GET /identity/v3/role_assignments?user.id=2e86fe36c9bf49a481c9f15ac7571b88&scope.project.id=c422a2290a14424da20e2841cbc1741d&role.id=2e45ca312cda4bef9263725ae1c6dab7 => generated 259 bytes in 346 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:38:32.076270 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941e8bb5-0c67-4f6f-83d8-a604a01a0362 None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:32.078170 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3182db06-8a06-4dd2-838e-c8676d7be4ea None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:32.163409 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9961de0-f18f-4ad3-a783-c7e84e54ad9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:32.164687 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9961de0-f18f-4ad3-a783-c7e84e54ad9e None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:32.165177 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9961de0-f18f-4ad3-a783-c7e84e54ad9e None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:32.165661 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9961de0-f18f-4ad3-a783-c7e84e54ad9e None admin] PATH_INFO: `/v3/projects/service` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:32.185039 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9961de0-f18f-4ad3-a783-c7e84e54ad9e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:38:32.188059 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9961de0-f18f-4ad3-a783-c7e84e54ad9e None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:38:32.216540 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application [None req-b9961de0-f18f-4ad3-a783-c7e84e54ad9e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 14:38:32.216540 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:38:32.216540 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:38:32.216540 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:38:32.216540 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:38:32.216540 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:38:32.216540 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:38:32.216540 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:38:32.216540 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:38:32.216540 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:38:32.216540 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:38:32.216540 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:38:32.216540 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 14:38:32.216540 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 14:38:32.216540 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 14:38:32.218171 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 14:38:32.218171 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:38:32.218171 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:38:32.218171 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:38:32.218171 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:38:32.218171 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:38:32.218171 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:38:32.218171 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:38:32.218171 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application with Lock( Jul 26 14:38:32.218171 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:38:32.218171 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:38:32.218171 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:38:32.218171 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:38:32.218171 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:38:32.218171 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:38:32.218171 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:38:32.218171 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:38:32.220351 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 14:38:32.220351 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 14:38:32.220351 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 14:38:32.220351 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 14:38:32.220351 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 14:38:32.220351 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 14:38:32.220351 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 14:38:32.220351 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Jul 26 14:38:32.229563 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 272/532] 10.222.0.93 () {56 vars in 1111 bytes} [Tue Jul 26 14:38:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 388 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:38:32.232851 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205b26a3-c835-4ee7-947e-3966457255cc None None] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:32.233782 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205b26a3-c835-4ee7-947e-3966457255cc None None] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:32.238675 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205b26a3-c835-4ee7-947e-3966457255cc None None] PATH_INFO: `/` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:32.243233 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 273/533] 10.222.0.93 () {54 vars in 926 bytes} [Tue Jul 26 14:38:32 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:38:32.245429 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205b26a3-c835-4ee7-947e-3966457255cc None None] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:32.273733 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:38:32.317760 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3182db06-8a06-4dd2-838e-c8676d7be4ea None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:32.366747 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:38:32.382273 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa77672-81bf-4546-b1ca-123e8705ae83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:32.382273 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa77672-81bf-4546-b1ca-123e8705ae83 None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:32.382273 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa77672-81bf-4546-b1ca-123e8705ae83 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:32.382273 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa77672-81bf-4546-b1ca-123e8705ae83 None admin] PATH_INFO: `/v3/users` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:32.384835 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa77672-81bf-4546-b1ca-123e8705ae83 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=87055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:38:32.385541 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa77672-81bf-4546-b1ca-123e8705ae83 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:38:32.389172 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa77672-81bf-4546-b1ca-123e8705ae83 None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:38:32.457275 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205b26a3-c835-4ee7-947e-3966457255cc None None] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:32.479179 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 261/534] 10.222.0.93 () {56 vars in 1139 bytes} [Tue Jul 26 14:38:32 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 402 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:38:32.481667 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e55d23-9c0f-41f2-859d-84f884252b52 None None] REQUEST_METHOD: `POST` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:32.482093 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e55d23-9c0f-41f2-859d-84f884252b52 None None] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:32.482626 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e55d23-9c0f-41f2-859d-84f884252b52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:32.516147 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.auth.core [None req-06e55d23-9c0f-41f2-859d-84f884252b52 None None] MFA Rules not processed for user `e5ef88cc058f425b882bcb87a1e1e75c`. Rule list: `[]` (Enabled: `True`). {{(pid=87055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:38:32.518277 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.fernet_utils [None req-06e55d23-9c0f-41f2-859d-84f884252b52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:38:32.532258 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27eced0f-cfea-4adc-b982-a99e7a044753 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:32.533624 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27eced0f-cfea-4adc-b982-a99e7a044753 None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:32.534401 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27eced0f-cfea-4adc-b982-a99e7a044753 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:32.536050 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27eced0f-cfea-4adc-b982-a99e7a044753 None admin] PATH_INFO: `/v3/projects` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:32.538938 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27eced0f-cfea-4adc-b982-a99e7a044753 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:38:32.539672 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27eced0f-cfea-4adc-b982-a99e7a044753 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:38:32.542795 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27eced0f-cfea-4adc-b982-a99e7a044753 None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:38:32.574664 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 274/535] 10.222.0.93 () {56 vars in 1148 bytes} [Tue Jul 26 14:38:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:38:32.576636 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27eced0f-cfea-4adc-b982-a99e7a044753 None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:32.677856 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 262/536] 10.222.0.93 () {58 vars in 1023 bytes} [Tue Jul 26 14:38:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 14:38:32.680426 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e55d23-9c0f-41f2-859d-84f884252b52 None None] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:32.805980 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27eced0f-cfea-4adc-b982-a99e7a044753 None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:32.852502 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:38:32.870169 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:38:32.880260 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea125f27-c75f-4750-8c50-6ecb3cbe2950 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:32.881692 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea125f27-c75f-4750-8c50-6ecb3cbe2950 None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:32.882408 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea125f27-c75f-4750-8c50-6ecb3cbe2950 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:32.882901 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea125f27-c75f-4750-8c50-6ecb3cbe2950 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:32.927638 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e55d23-9c0f-41f2-859d-84f884252b52 None None] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:33.000545 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83509fe-e4c1-4d13-afd7-d1ee20921d42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:33.002185 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83509fe-e4c1-4d13-afd7-d1ee20921d42 None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:33.003042 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83509fe-e4c1-4d13-afd7-d1ee20921d42 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:33.003883 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83509fe-e4c1-4d13-afd7-d1ee20921d42 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:33.005962 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83509fe-e4c1-4d13-afd7-d1ee20921d42 None admin] RBAC: Adding query filter params (role.id=2e45ca312cda4bef9263725ae1c6dab7, scope.project.id=c422a2290a14424da20e2841cbc1741d, user.id=6780136eb21e4c8da1950b126284639e) {{(pid=87055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:38:33.007657 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83509fe-e4c1-4d13-afd7-d1ee20921d42 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:38:33.010765 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83509fe-e4c1-4d13-afd7-d1ee20921d42 None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:38:33.031054 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 263/537] 10.222.0.93 () {56 vars in 1374 bytes} [Tue Jul 26 14:38:32 2022] GET /identity/v3/role_assignments?user.id=6780136eb21e4c8da1950b126284639e&scope.project.id=c422a2290a14424da20e2841cbc1741d&role.id=2e45ca312cda4bef9263725ae1c6dab7 => generated 259 bytes in 352 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:38:33.033535 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83509fe-e4c1-4d13-afd7-d1ee20921d42 None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:33.071037 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea125f27-c75f-4750-8c50-6ecb3cbe2950 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:38:33.074273 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea125f27-c75f-4750-8c50-6ecb3cbe2950 None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:38:33.347492 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83509fe-e4c1-4d13-afd7-d1ee20921d42 None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:33.417982 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7309ac-931b-4ede-bd25-77156c4581f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:33.419128 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7309ac-931b-4ede-bd25-77156c4581f0 None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:33.419626 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7309ac-931b-4ede-bd25-77156c4581f0 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:33.420166 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7309ac-931b-4ede-bd25-77156c4581f0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:33.429878 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 275/538] 10.222.0.93 () {58 vars in 1282 bytes} [Tue Jul 26 14:38:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 854 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 14:38:33.435002 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:38:33.440020 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea125f27-c75f-4750-8c50-6ecb3cbe2950 None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:33.444838 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7309ac-931b-4ede-bd25-77156c4581f0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 14:38:33.455300 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application [None req-ec7309ac-931b-4ede-bd25-77156c4581f0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 26 14:38:33.455300 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:38:33.455300 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:38:33.455300 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:38:33.455300 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:38:33.455300 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:38:33.455300 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:38:33.455300 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:38:33.455300 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:38:33.455300 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:38:33.455300 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:38:33.455300 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:38:33.455300 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 14:38:33.455300 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 14:38:33.455300 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 14:38:33.455300 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 14:38:33.457089 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 14:38:33.457089 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 14:38:33.457089 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 14:38:33.457089 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 14:38:33.457089 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:38:33.457089 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:38:33.457089 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:38:33.457089 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:38:33.457089 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:38:33.457089 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:38:33.457089 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:38:33.457089 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application with Lock( Jul 26 14:38:33.457089 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:38:33.457089 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:38:33.457089 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:38:33.457089 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:38:33.458692 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:38:33.458692 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:38:33.458692 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:38:33.458692 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:38:33.458692 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 14:38:33.458692 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 14:38:33.458692 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 14:38:33.458692 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 14:38:33.458692 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 14:38:33.458692 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 14:38:33.458692 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 26 14:38:33.458692 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Jul 26 14:38:33.463013 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 264/539] 10.222.0.93 () {56 vars in 1102 bytes} [Tue Jul 26 14:38:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 425 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:38:33.468020 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340c1489-0c47-4dd5-b46f-ba6c127b52d7 None None] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:33.468505 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340c1489-0c47-4dd5-b46f-ba6c127b52d7 None None] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:33.468991 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340c1489-0c47-4dd5-b46f-ba6c127b52d7 None None] PATH_INFO: `/` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:33.473669 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 265/540] 10.222.0.93 () {54 vars in 926 bytes} [Tue Jul 26 14:38:33 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 14:38:33.475759 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340c1489-0c47-4dd5-b46f-ba6c127b52d7 None None] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:33.500255 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:38:33.663396 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea125f27-c75f-4750-8c50-6ecb3cbe2950 None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:33.675790 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340c1489-0c47-4dd5-b46f-ba6c127b52d7 None None] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:33.745566 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b89cce3-6f26-49ea-a4ae-6cdebf89b8a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:33.745566 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b89cce3-6f26-49ea-a4ae-6cdebf89b8a4 None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:33.745566 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b89cce3-6f26-49ea-a4ae-6cdebf89b8a4 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:33.745566 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b89cce3-6f26-49ea-a4ae-6cdebf89b8a4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:33.746213 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ce3785-1bf0-4096-8a6b-e7d76fc05269 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:33.746213 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ce3785-1bf0-4096-8a6b-e7d76fc05269 None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:33.746213 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ce3785-1bf0-4096-8a6b-e7d76fc05269 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:33.746213 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ce3785-1bf0-4096-8a6b-e7d76fc05269 None admin] PATH_INFO: `/v3/roles` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:33.747671 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ce3785-1bf0-4096-8a6b-e7d76fc05269 None admin] RBAC: Adding query filter params (name=service) {{(pid=87055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:38:33.748307 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ce3785-1bf0-4096-8a6b-e7d76fc05269 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:38:33.751093 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ce3785-1bf0-4096-8a6b-e7d76fc05269 None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:38:33.757872 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b89cce3-6f26-49ea-a4ae-6cdebf89b8a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:38:33.759546 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b89cce3-6f26-49ea-a4ae-6cdebf89b8a4 None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:38:33.777345 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application [None req-6b89cce3-6f26-49ea-a4ae-6cdebf89b8a4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:38:33.777345 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:38:33.777345 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:38:33.777345 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:38:33.777345 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:38:33.777345 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:38:33.777345 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:38:33.777345 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:38:33.777345 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:38:33.777345 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:38:33.777345 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:38:33.777345 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:38:33.777345 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 14:38:33.777345 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 14:38:33.777345 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 14:38:33.779023 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 14:38:33.779023 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:38:33.779023 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:38:33.779023 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:38:33.779023 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:38:33.779023 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:38:33.779023 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:38:33.779023 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:38:33.779023 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application with Lock( Jul 26 14:38:33.779023 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:38:33.779023 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:38:33.779023 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:38:33.779023 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:38:33.779023 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:38:33.779023 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:38:33.779023 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:38:33.779023 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:38:33.780592 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 14:38:33.780592 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 14:38:33.780592 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:38:33.780592 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Jul 26 14:38:33.781010 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 266/541] 10.222.0.93 () {56 vars in 1103 bytes} [Tue Jul 26 14:38:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:38:33.781155 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 276/542] 10.222.0.93 () {56 vars in 1108 bytes} [Tue Jul 26 14:38:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 340 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:38:33.781279 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaaf535-9bf2-42e6-986a-b9700f9c50d4 None None] REQUEST_METHOD: `POST` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:33.781279 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaaf535-9bf2-42e6-986a-b9700f9c50d4 None None] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:33.781521 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaaf535-9bf2-42e6-986a-b9700f9c50d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:33.791631 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b89cce3-6f26-49ea-a4ae-6cdebf89b8a4 None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:33.818641 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.auth.core [None req-0eaaf535-9bf2-42e6-986a-b9700f9c50d4 None None] MFA Rules not processed for user `e5ef88cc058f425b882bcb87a1e1e75c`. Rule list: `[]` (Enabled: `True`). {{(pid=87055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:38:33.821633 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.fernet_utils [None req-0eaaf535-9bf2-42e6-986a-b9700f9c50d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:38:33.902632 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:38:33.910890 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 267/543] 10.222.0.93 () {58 vars in 1023 bytes} [Tue Jul 26 14:38:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 14:38:33.914354 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eaaf535-9bf2-42e6-986a-b9700f9c50d4 None None] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:33.952054 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:38:34.019154 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b89cce3-6f26-49ea-a4ae-6cdebf89b8a4 None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:34.038976 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eaaf535-9bf2-42e6-986a-b9700f9c50d4 None None] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:34.080108 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702c428b-7911-490f-ab01-948bcc024dae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:34.081107 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702c428b-7911-490f-ab01-948bcc024dae None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:34.081569 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702c428b-7911-490f-ab01-948bcc024dae None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:34.082027 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702c428b-7911-490f-ab01-948bcc024dae None admin] PATH_INFO: `/v3/domains` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:34.083101 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702c428b-7911-490f-ab01-948bcc024dae None admin] RBAC: Adding query filter params (name=Default) {{(pid=87055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:38:34.083602 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702c428b-7911-490f-ab01-948bcc024dae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:38:34.085365 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702c428b-7911-490f-ab01-948bcc024dae None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:38:34.093382 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb95a611-1da6-4a71-8641-e3a42f5b8917 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:34.094858 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb95a611-1da6-4a71-8641-e3a42f5b8917 None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:34.095412 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb95a611-1da6-4a71-8641-e3a42f5b8917 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:34.096006 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb95a611-1da6-4a71-8641-e3a42f5b8917 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:34.102161 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 268/544] 10.222.0.93 () {56 vars in 1109 bytes} [Tue Jul 26 14:38:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:38:34.103485 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702c428b-7911-490f-ab01-948bcc024dae None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:34.121011 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb95a611-1da6-4a71-8641-e3a42f5b8917 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:38:34.124406 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb95a611-1da6-4a71-8641-e3a42f5b8917 None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:38:34.156057 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application [None req-fb95a611-1da6-4a71-8641-e3a42f5b8917 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:38:34.156057 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:38:34.156057 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:38:34.156057 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:38:34.156057 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:38:34.156057 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:38:34.156057 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:38:34.156057 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:38:34.156057 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:38:34.156057 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:38:34.156057 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:38:34.156057 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:38:34.156057 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 14:38:34.156057 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 14:38:34.156057 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 14:38:34.157261 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 14:38:34.157261 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:38:34.157261 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:38:34.157261 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:38:34.157261 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:38:34.157261 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:38:34.157261 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:38:34.157261 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:38:34.157261 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application with Lock( Jul 26 14:38:34.157261 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:38:34.157261 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:38:34.157261 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:38:34.157261 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:38:34.157261 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:38:34.157261 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:38:34.157261 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:38:34.157261 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:38:34.158221 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 14:38:34.158221 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 14:38:34.158221 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:38:34.158221 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Jul 26 14:38:34.165673 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 277/545] 10.222.0.93 () {56 vars in 1108 bytes} [Tue Jul 26 14:38:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 375 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:38:34.167525 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb95a611-1da6-4a71-8641-e3a42f5b8917 None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:34.172506 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:38:34.229611 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702c428b-7911-490f-ab01-948bcc024dae None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:34.270220 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5db17a6-ac21-498a-b846-100ded62ed85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:34.271176 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5db17a6-ac21-498a-b846-100ded62ed85 None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:34.271566 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5db17a6-ac21-498a-b846-100ded62ed85 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:34.272032 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5db17a6-ac21-498a-b846-100ded62ed85 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:34.285612 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5db17a6-ac21-498a-b846-100ded62ed85 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 14:38:34.291739 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application [None req-d5db17a6-ac21-498a-b846-100ded62ed85 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 26 14:38:34.291739 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:38:34.291739 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:38:34.291739 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:38:34.291739 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:38:34.291739 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:38:34.291739 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:38:34.291739 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:38:34.291739 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:38:34.291739 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:38:34.291739 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:38:34.291739 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:38:34.291739 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 14:38:34.291739 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 14:38:34.291739 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 14:38:34.291739 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 14:38:34.294552 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 14:38:34.294552 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 14:38:34.294552 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 14:38:34.294552 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 14:38:34.294552 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:38:34.294552 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:38:34.294552 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:38:34.294552 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:38:34.294552 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:38:34.294552 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:38:34.294552 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:38:34.294552 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application with Lock( Jul 26 14:38:34.294552 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:38:34.294552 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:38:34.294552 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:38:34.294552 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:38:34.296440 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:38:34.296440 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:38:34.296440 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:38:34.296440 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:38:34.296440 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 14:38:34.296440 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 14:38:34.296440 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 14:38:34.296440 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 14:38:34.296440 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 14:38:34.296440 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 14:38:34.296440 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 26 14:38:34.296440 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Jul 26 14:38:34.296440 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 269/546] 10.222.0.93 () {56 vars in 1102 bytes} [Tue Jul 26 14:38:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:38:34.296440 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5db17a6-ac21-498a-b846-100ded62ed85 None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:34.405841 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb95a611-1da6-4a71-8641-e3a42f5b8917 None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:34.418161 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5db17a6-ac21-498a-b846-100ded62ed85 None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:34.431356 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:38:34.459245 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90828de0-c660-4864-a465-210a2b56a78f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:34.460566 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90828de0-c660-4864-a465-210a2b56a78f None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:34.460896 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90828de0-c660-4864-a465-210a2b56a78f None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:34.461248 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90828de0-c660-4864-a465-210a2b56a78f None admin] PATH_INFO: `/v3/domains` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:34.461946 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90828de0-c660-4864-a465-210a2b56a78f None admin] RBAC: Adding query filter params (name=Default) {{(pid=87055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:38:34.462276 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90828de0-c660-4864-a465-210a2b56a78f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:38:34.464216 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90828de0-c660-4864-a465-210a2b56a78f None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:38:34.470903 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:38:34.485769 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 270/547] 10.222.0.93 () {56 vars in 1109 bytes} [Tue Jul 26 14:38:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:38:34.492590 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90828de0-c660-4864-a465-210a2b56a78f None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:34.492748 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a9dc19-03cb-4613-a050-66d9612d6cd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:34.493381 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a9dc19-03cb-4613-a050-66d9612d6cd5 None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:34.493955 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a9dc19-03cb-4613-a050-66d9612d6cd5 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:34.494591 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a9dc19-03cb-4613-a050-66d9612d6cd5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:34.508864 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a9dc19-03cb-4613-a050-66d9612d6cd5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:38:34.512216 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a9dc19-03cb-4613-a050-66d9612d6cd5 None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:38:34.539989 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application [None req-90a9dc19-03cb-4613-a050-66d9612d6cd5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 14:38:34.539989 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:38:34.539989 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:38:34.539989 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:38:34.539989 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:38:34.539989 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:38:34.539989 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:38:34.539989 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:38:34.539989 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:38:34.539989 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:38:34.539989 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:38:34.539989 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:38:34.539989 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 14:38:34.539989 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 14:38:34.539989 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 14:38:34.540943 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 14:38:34.540943 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:38:34.540943 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:38:34.540943 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:38:34.540943 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:38:34.540943 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:38:34.540943 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:38:34.540943 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:38:34.540943 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application with Lock( Jul 26 14:38:34.540943 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:38:34.540943 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:38:34.540943 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:38:34.540943 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:38:34.540943 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:38:34.540943 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:38:34.540943 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:38:34.540943 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:38:34.541999 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 14:38:34.541999 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 14:38:34.541999 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 14:38:34.541999 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 14:38:34.541999 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 14:38:34.541999 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 14:38:34.541999 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 14:38:34.541999 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Jul 26 14:38:34.543346 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 278/548] 10.222.0.93 () {56 vars in 1111 bytes} [Tue Jul 26 14:38:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 377 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:38:34.545164 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a9dc19-03cb-4613-a050-66d9612d6cd5 None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:34.611459 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90828de0-c660-4864-a465-210a2b56a78f None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:34.651709 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06de87c-0d5f-40d5-99e3-6cb4fd6c9563 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:34.652662 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06de87c-0d5f-40d5-99e3-6cb4fd6c9563 None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:34.653186 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06de87c-0d5f-40d5-99e3-6cb4fd6c9563 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:34.653669 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06de87c-0d5f-40d5-99e3-6cb4fd6c9563 None admin] PATH_INFO: `/v3/roles` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:34.654709 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06de87c-0d5f-40d5-99e3-6cb4fd6c9563 None admin] RBAC: Adding query filter params (name=service) {{(pid=87055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:38:34.655235 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06de87c-0d5f-40d5-99e3-6cb4fd6c9563 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:38:34.657135 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06de87c-0d5f-40d5-99e3-6cb4fd6c9563 None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:38:34.667725 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 271/549] 10.222.0.93 () {56 vars in 1103 bytes} [Tue Jul 26 14:38:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:38:34.669069 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06de87c-0d5f-40d5-99e3-6cb4fd6c9563 None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:34.707903 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:38:34.773125 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a9dc19-03cb-4613-a050-66d9612d6cd5 None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:34.793353 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06de87c-0d5f-40d5-99e3-6cb4fd6c9563 None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:34.838369 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f86853-600c-47bc-aa6a-7e4c407f788e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:34.839490 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f86853-600c-47bc-aa6a-7e4c407f788e None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:34.839978 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f86853-600c-47bc-aa6a-7e4c407f788e None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:34.840463 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f86853-600c-47bc-aa6a-7e4c407f788e None admin] PATH_INFO: `/v3/projects` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:34.841477 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f86853-600c-47bc-aa6a-7e4c407f788e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:38:34.842142 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f86853-600c-47bc-aa6a-7e4c407f788e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:38:34.843960 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f86853-600c-47bc-aa6a-7e4c407f788e None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:38:34.844454 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b81f28a-2733-4525-bb05-7cf30f51ff76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:34.845567 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b81f28a-2733-4525-bb05-7cf30f51ff76 None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:34.846077 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b81f28a-2733-4525-bb05-7cf30f51ff76 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:34.846602 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b81f28a-2733-4525-bb05-7cf30f51ff76 None admin] PATH_INFO: `/v3/users/swift` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:34.863586 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b81f28a-2733-4525-bb05-7cf30f51ff76 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:38:34.865473 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b81f28a-2733-4525-bb05-7cf30f51ff76 None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:38:34.865934 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 272/550] 10.222.0.93 () {56 vars in 1148 bytes} [Tue Jul 26 14:38:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:38:34.867514 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f86853-600c-47bc-aa6a-7e4c407f788e None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:34.883072 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application [None req-3b81f28a-2733-4525-bb05-7cf30f51ff76 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 26 14:38:34.883072 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:38:34.883072 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:38:34.883072 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:38:34.883072 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:38:34.883072 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:38:34.883072 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:38:34.883072 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:38:34.883072 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:38:34.883072 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:38:34.883072 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:38:34.883072 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:38:34.883072 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 14:38:34.883072 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 14:38:34.883072 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 14:38:34.883072 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 14:38:34.884057 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:38:34.884057 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:38:34.884057 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 14:38:34.884057 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 14:38:34.884057 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 14:38:34.884057 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 14:38:34.884057 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:38:34.884057 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:38:34.884057 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:38:34.884057 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:38:34.884057 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:38:34.884057 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application with Lock( Jul 26 14:38:34.884057 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:38:34.884057 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:38:34.884057 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:38:34.884057 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:38:34.884057 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:38:34.884057 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:38:34.884966 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:38:34.884966 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:38:34.884966 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 14:38:34.884966 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 14:38:34.884966 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 14:38:34.884966 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 14:38:34.884966 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 14:38:34.884966 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 14:38:34.884966 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 26 14:38:34.884966 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Jul 26 14:38:34.892921 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 279/551] 10.222.0.93 () {56 vars in 1096 bytes} [Tue Jul 26 14:38:34 2022] GET /identity/v3/users/swift => generated 83 bytes in 344 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:38:34.892921 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b81f28a-2733-4525-bb05-7cf30f51ff76 None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:34.972700 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:38:35.026719 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:38:35.037114 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f86853-600c-47bc-aa6a-7e4c407f788e None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:35.082031 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b81f28a-2733-4525-bb05-7cf30f51ff76 None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:35.087752 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5259aea-3258-4d90-9c88-bf723a96d745 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:35.089692 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5259aea-3258-4d90-9c88-bf723a96d745 None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:35.090040 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5259aea-3258-4d90-9c88-bf723a96d745 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:35.090493 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5259aea-3258-4d90-9c88-bf723a96d745 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:35.106485 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5259aea-3258-4d90-9c88-bf723a96d745 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:38:35.110388 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5259aea-3258-4d90-9c88-bf723a96d745 None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:38:35.153130 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application [None req-b5259aea-3258-4d90-9c88-bf723a96d745 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:38:35.153130 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:38:35.153130 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:38:35.153130 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:38:35.153130 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:38:35.153130 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:38:35.153130 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:38:35.153130 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:38:35.153130 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:38:35.153130 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:38:35.153130 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:38:35.153130 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:38:35.153130 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 14:38:35.153130 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 14:38:35.153130 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 14:38:35.154151 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 14:38:35.154151 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:38:35.154151 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:38:35.154151 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:38:35.154151 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:38:35.154151 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:38:35.154151 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:38:35.154151 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:38:35.154151 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application with Lock( Jul 26 14:38:35.154151 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:38:35.154151 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:38:35.154151 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:38:35.154151 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:38:35.154151 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:38:35.154151 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:38:35.154151 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:38:35.154151 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:38:35.155055 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 14:38:35.155055 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 14:38:35.155055 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:38:35.155055 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Jul 26 14:38:35.157344 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 273/552] 10.222.0.93 () {56 vars in 1108 bytes} [Tue Jul 26 14:38:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:38:35.158752 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5259aea-3258-4d90-9c88-bf723a96d745 None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:35.161638 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0175d461-312d-41d1-af4e-fcd772dcec88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:35.163296 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0175d461-312d-41d1-af4e-fcd772dcec88 None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:35.163834 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0175d461-312d-41d1-af4e-fcd772dcec88 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:35.164297 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0175d461-312d-41d1-af4e-fcd772dcec88 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:35.166044 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0175d461-312d-41d1-af4e-fcd772dcec88 None admin] RBAC: Adding query filter params (role.id=2e45ca312cda4bef9263725ae1c6dab7, scope.project.id=c422a2290a14424da20e2841cbc1741d, user.id=541dcf2b85a145e99c7d0663a0ac0918) {{(pid=87056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:38:35.166686 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0175d461-312d-41d1-af4e-fcd772dcec88 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:38:35.169467 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0175d461-312d-41d1-af4e-fcd772dcec88 None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:38:35.180191 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 280/553] 10.222.0.93 () {56 vars in 1374 bytes} [Tue Jul 26 14:38:34 2022] GET /identity/v3/role_assignments?user.id=541dcf2b85a145e99c7d0663a0ac0918&scope.project.id=c422a2290a14424da20e2841cbc1741d&role.id=2e45ca312cda4bef9263725ae1c6dab7 => generated 259 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:38:35.181829 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0175d461-312d-41d1-af4e-fcd772dcec88 None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:35.387241 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5259aea-3258-4d90-9c88-bf723a96d745 None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:35.395978 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0175d461-312d-41d1-af4e-fcd772dcec88 None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:35.421596 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:38:35.455797 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f969cfe-2bf6-4c98-9db1-7374f3a73a9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:35.457201 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f969cfe-2bf6-4c98-9db1-7374f3a73a9b None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:35.457670 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f969cfe-2bf6-4c98-9db1-7374f3a73a9b None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:35.458125 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f969cfe-2bf6-4c98-9db1-7374f3a73a9b None admin] PATH_INFO: `/v3/users` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:35.460207 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f969cfe-2bf6-4c98-9db1-7374f3a73a9b None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=87055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:38:35.460854 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f969cfe-2bf6-4c98-9db1-7374f3a73a9b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:38:35.463677 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f969cfe-2bf6-4c98-9db1-7374f3a73a9b None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:38:35.464904 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9567229a-4718-4005-a966-fac495724865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:35.466145 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9567229a-4718-4005-a966-fac495724865 None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:35.466852 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9567229a-4718-4005-a966-fac495724865 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:35.467496 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9567229a-4718-4005-a966-fac495724865 None admin] PATH_INFO: `/v3/domains` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:35.469036 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9567229a-4718-4005-a966-fac495724865 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:38:35.469742 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9567229a-4718-4005-a966-fac495724865 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:38:35.472422 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9567229a-4718-4005-a966-fac495724865 None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:38:35.494976 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 281/554] 10.222.0.93 () {56 vars in 1109 bytes} [Tue Jul 26 14:38:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:38:35.497556 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76217579-47f5-4c06-ba49-cbb3a5e56011 None None] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:35.498407 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76217579-47f5-4c06-ba49-cbb3a5e56011 None None] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:35.499146 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76217579-47f5-4c06-ba49-cbb3a5e56011 None None] PATH_INFO: `/` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:35.502289 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 282/555] 10.222.0.93 () {54 vars in 926 bytes} [Tue Jul 26 14:38:35 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:38:35.503947 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76217579-47f5-4c06-ba49-cbb3a5e56011 None None] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:35.510372 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 274/556] 10.222.0.93 () {56 vars in 1135 bytes} [Tue Jul 26 14:38:35 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 348 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:38:35.513271 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71479f61-5d75-43fe-95ab-4dbda6930561 None None] REQUEST_METHOD: `POST` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:35.514047 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71479f61-5d75-43fe-95ab-4dbda6930561 None None] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:35.514912 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71479f61-5d75-43fe-95ab-4dbda6930561 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:35.525909 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:38:35.544631 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.auth.core [None req-71479f61-5d75-43fe-95ab-4dbda6930561 None None] MFA Rules not processed for user `e5ef88cc058f425b882bcb87a1e1e75c`. Rule list: `[]` (Enabled: `True`). {{(pid=87055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:38:35.546206 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.fernet_utils [None req-71479f61-5d75-43fe-95ab-4dbda6930561 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:38:35.637147 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 275/557] 10.222.0.93 () {58 vars in 1023 bytes} [Tue Jul 26 14:38:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 14:38:35.638536 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71479f61-5d75-43fe-95ab-4dbda6930561 None None] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:35.774074 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76217579-47f5-4c06-ba49-cbb3a5e56011 None None] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:35.779667 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71479f61-5d75-43fe-95ab-4dbda6930561 None None] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:35.820608 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:38:35.827529 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c3a90d-4c55-4eac-bfbf-6b2aa4ba6fff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:35.828721 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c3a90d-4c55-4eac-bfbf-6b2aa4ba6fff None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:35.835799 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c3a90d-4c55-4eac-bfbf-6b2aa4ba6fff None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:35.835799 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c3a90d-4c55-4eac-bfbf-6b2aa4ba6fff None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:35.872820 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2919e54-63b3-4e4b-a652-bd1cd4704a53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:35.873976 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2919e54-63b3-4e4b-a652-bd1cd4704a53 None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:35.874549 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2919e54-63b3-4e4b-a652-bd1cd4704a53 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:35.875061 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2919e54-63b3-4e4b-a652-bd1cd4704a53 None admin] PATH_INFO: `/v3/users/glance` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:35.890817 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2919e54-63b3-4e4b-a652-bd1cd4704a53 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:38:35.893722 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2919e54-63b3-4e4b-a652-bd1cd4704a53 None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:38:35.908234 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application [None req-d2919e54-63b3-4e4b-a652-bd1cd4704a53 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 26 14:38:35.908234 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:38:35.908234 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:38:35.908234 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:38:35.908234 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:38:35.908234 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:38:35.908234 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:38:35.908234 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:38:35.908234 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:38:35.908234 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:38:35.908234 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:38:35.908234 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:38:35.908234 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 14:38:35.908234 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 14:38:35.908234 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 14:38:35.908234 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 14:38:35.910777 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:38:35.910777 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:38:35.910777 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 14:38:35.910777 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 14:38:35.910777 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 14:38:35.910777 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 14:38:35.910777 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:38:35.910777 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:38:35.910777 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:38:35.910777 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:38:35.910777 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:38:35.910777 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application with Lock( Jul 26 14:38:35.910777 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:38:35.910777 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:38:35.910777 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:38:35.910777 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:38:35.910777 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:38:35.910777 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:38:35.913554 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:38:35.913554 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:38:35.913554 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 14:38:35.913554 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 14:38:35.913554 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 14:38:35.913554 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 14:38:35.913554 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 14:38:35.913554 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 14:38:35.913554 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 26 14:38:35.913554 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Jul 26 14:38:35.913554 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 283/558] 10.222.0.93 () {56 vars in 1099 bytes} [Tue Jul 26 14:38:35 2022] GET /identity/v3/users/glance => generated 84 bytes in 407 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:38:35.913554 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2919e54-63b3-4e4b-a652-bd1cd4704a53 None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:35.964620 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:38:35.993530 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c3a90d-4c55-4eac-bfbf-6b2aa4ba6fff None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:38:35.996956 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c3a90d-4c55-4eac-bfbf-6b2aa4ba6fff None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:38:36.082259 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2919e54-63b3-4e4b-a652-bd1cd4704a53 None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:36.159782 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ab3dca-7399-4064-8033-a2ff0442b486 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:36.160839 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ab3dca-7399-4064-8033-a2ff0442b486 None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:36.161561 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ab3dca-7399-4064-8033-a2ff0442b486 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:36.161826 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ab3dca-7399-4064-8033-a2ff0442b486 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:36.186424 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 276/559] 10.222.0.93 () {58 vars in 1282 bytes} [Tue Jul 26 14:38:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 544 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 14:38:36.186424 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c3a90d-4c55-4eac-bfbf-6b2aa4ba6fff None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:36.188203 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ab3dca-7399-4064-8033-a2ff0442b486 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 14:38:36.198612 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application [None req-c6ab3dca-7399-4064-8033-a2ff0442b486 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 26 14:38:36.198612 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:38:36.198612 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:38:36.198612 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:38:36.198612 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:38:36.198612 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:38:36.198612 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:38:36.198612 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:38:36.198612 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:38:36.198612 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:38:36.198612 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:38:36.198612 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:38:36.198612 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 14:38:36.198612 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 14:38:36.198612 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 14:38:36.198612 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 14:38:36.199924 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 14:38:36.199924 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 14:38:36.199924 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 14:38:36.199924 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 14:38:36.199924 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:38:36.199924 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:38:36.199924 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:38:36.199924 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:38:36.199924 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:38:36.199924 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:38:36.199924 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:38:36.199924 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application with Lock( Jul 26 14:38:36.199924 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:38:36.199924 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:38:36.199924 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:38:36.199924 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:38:36.201139 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:38:36.201139 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:38:36.201139 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:38:36.201139 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:38:36.201139 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 14:38:36.201139 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 14:38:36.201139 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 14:38:36.201139 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 14:38:36.201139 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 14:38:36.201139 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 14:38:36.201139 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 26 14:38:36.201139 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Jul 26 14:38:36.202632 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 284/560] 10.222.0.93 () {56 vars in 1102 bytes} [Tue Jul 26 14:38:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:38:36.205025 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bac07c-fd46-484b-9a83-5e53cda7d6d6 None None] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:36.205529 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bac07c-fd46-484b-9a83-5e53cda7d6d6 None None] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:36.206112 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bac07c-fd46-484b-9a83-5e53cda7d6d6 None None] PATH_INFO: `/` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:36.208967 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 285/561] 10.222.0.93 () {54 vars in 926 bytes} [Tue Jul 26 14:38:36 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:38:36.210439 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bac07c-fd46-484b-9a83-5e53cda7d6d6 None None] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:36.255397 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:38:36.373546 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:38:36.391185 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bac07c-fd46-484b-9a83-5e53cda7d6d6 None None] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:36.391806 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c3a90d-4c55-4eac-bfbf-6b2aa4ba6fff None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:36.443029 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4efac5-bf3e-4bf7-ab4f-4d40e644a23a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:36.443566 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4efac5-bf3e-4bf7-ab4f-4d40e644a23a None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:36.443872 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4efac5-bf3e-4bf7-ab4f-4d40e644a23a None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:36.444748 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4efac5-bf3e-4bf7-ab4f-4d40e644a23a None admin] PATH_INFO: `/v3/users` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:36.445594 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4efac5-bf3e-4bf7-ab4f-4d40e644a23a None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=87055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:38:36.445903 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4efac5-bf3e-4bf7-ab4f-4d40e644a23a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:38:36.447781 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4efac5-bf3e-4bf7-ab4f-4d40e644a23a None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:38:36.462206 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9815cbab-9301-468d-8cbd-db5ec25a9c16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:36.463367 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9815cbab-9301-468d-8cbd-db5ec25a9c16 None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:36.463775 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9815cbab-9301-468d-8cbd-db5ec25a9c16 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:36.464174 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9815cbab-9301-468d-8cbd-db5ec25a9c16 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:36.478720 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 277/562] 10.222.0.93 () {56 vars in 1137 bytes} [Tue Jul 26 14:38:36 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:38:36.479728 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4efac5-bf3e-4bf7-ab4f-4d40e644a23a None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:36.486855 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9815cbab-9301-468d-8cbd-db5ec25a9c16 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:38:36.489634 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9815cbab-9301-468d-8cbd-db5ec25a9c16 None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:38:36.522378 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application [None req-9815cbab-9301-468d-8cbd-db5ec25a9c16 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:38:36.522378 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:38:36.522378 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:38:36.522378 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:38:36.522378 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:38:36.522378 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:38:36.522378 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:38:36.522378 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:38:36.522378 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:38:36.522378 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:38:36.522378 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:38:36.522378 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:38:36.522378 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 14:38:36.522378 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 14:38:36.522378 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 14:38:36.523668 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 14:38:36.523668 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:38:36.523668 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:38:36.523668 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:38:36.523668 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:38:36.523668 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:38:36.523668 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:38:36.523668 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:38:36.523668 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application with Lock( Jul 26 14:38:36.523668 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:38:36.523668 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:38:36.523668 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:38:36.523668 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:38:36.523668 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:38:36.523668 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:38:36.523668 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:38:36.523668 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:38:36.527740 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 14:38:36.527740 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 14:38:36.527740 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:38:36.527740 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Jul 26 14:38:36.527740 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 286/563] 10.222.0.93 () {56 vars in 1108 bytes} [Tue Jul 26 14:38:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:38:36.527740 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a269cf1c-6956-45c9-be11-dc64443c5bdc None None] REQUEST_METHOD: `POST` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:36.527740 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a269cf1c-6956-45c9-be11-dc64443c5bdc None None] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:36.527740 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a269cf1c-6956-45c9-be11-dc64443c5bdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:36.559916 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.auth.core [None req-a269cf1c-6956-45c9-be11-dc64443c5bdc None None] MFA Rules not processed for user `e5ef88cc058f425b882bcb87a1e1e75c`. Rule list: `[]` (Enabled: `True`). {{(pid=87056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:38:36.561906 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.fernet_utils [None req-a269cf1c-6956-45c9-be11-dc64443c5bdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:38:36.619989 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:38:36.636990 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4efac5-bf3e-4bf7-ab4f-4d40e644a23a None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:36.686589 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 287/564] 10.222.0.93 () {58 vars in 1023 bytes} [Tue Jul 26 14:38:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 14:38:36.687750 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a269cf1c-6956-45c9-be11-dc64443c5bdc None None] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:36.698129 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b7ea47-81a0-458d-9c2d-ca236bd23536 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:36.699027 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b7ea47-81a0-458d-9c2d-ca236bd23536 None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:36.699978 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b7ea47-81a0-458d-9c2d-ca236bd23536 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:36.699978 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b7ea47-81a0-458d-9c2d-ca236bd23536 None admin] PATH_INFO: `/v3/roles` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:36.701000 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b7ea47-81a0-458d-9c2d-ca236bd23536 None admin] RBAC: Adding query filter params (name=service) {{(pid=87055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:38:36.701473 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b7ea47-81a0-458d-9c2d-ca236bd23536 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:38:36.704172 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b7ea47-81a0-458d-9c2d-ca236bd23536 None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:38:36.718940 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 278/565] 10.222.0.93 () {56 vars in 1103 bytes} [Tue Jul 26 14:38:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:38:36.720045 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b7ea47-81a0-458d-9c2d-ca236bd23536 None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:36.822783 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:38:36.854407 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b7ea47-81a0-458d-9c2d-ca236bd23536 None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:36.872083 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a269cf1c-6956-45c9-be11-dc64443c5bdc None None] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:36.901799 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39e7453-85ad-4ea0-9001-74f9dee1a82e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:36.902840 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39e7453-85ad-4ea0-9001-74f9dee1a82e None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:36.903310 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39e7453-85ad-4ea0-9001-74f9dee1a82e None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:36.903769 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39e7453-85ad-4ea0-9001-74f9dee1a82e None admin] PATH_INFO: `/v3/domains` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:36.904848 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39e7453-85ad-4ea0-9001-74f9dee1a82e None admin] RBAC: Adding query filter params (name=Default) {{(pid=87055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:38:36.905375 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39e7453-85ad-4ea0-9001-74f9dee1a82e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:38:36.908189 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39e7453-85ad-4ea0-9001-74f9dee1a82e None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:38:36.933871 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 279/566] 10.222.0.93 () {56 vars in 1109 bytes} [Tue Jul 26 14:38:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:38:36.935017 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39e7453-85ad-4ea0-9001-74f9dee1a82e None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:36.944773 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a87e42b-a1a5-452a-9166-febb26855e56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:36.945966 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a87e42b-a1a5-452a-9166-febb26855e56 None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:36.946534 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a87e42b-a1a5-452a-9166-febb26855e56 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:36.947109 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a87e42b-a1a5-452a-9166-febb26855e56 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:36.966283 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a87e42b-a1a5-452a-9166-febb26855e56 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:38:36.969039 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a87e42b-a1a5-452a-9166-febb26855e56 None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:38:36.971097 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:38:36.998032 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application [None req-5a87e42b-a1a5-452a-9166-febb26855e56 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:38:36.998032 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:38:36.998032 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:38:36.998032 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:38:36.998032 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:38:36.998032 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:38:36.998032 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:38:36.998032 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:38:36.998032 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:38:36.998032 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:38:36.998032 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:38:36.998032 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:38:36.998032 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 14:38:36.998032 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 14:38:36.998032 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 14:38:36.999741 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 14:38:36.999741 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:38:36.999741 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:38:36.999741 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:38:36.999741 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:38:36.999741 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:38:36.999741 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:38:36.999741 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:38:36.999741 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application with Lock( Jul 26 14:38:36.999741 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:38:36.999741 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:38:36.999741 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:38:36.999741 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:38:36.999741 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:38:36.999741 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:38:36.999741 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:38:36.999741 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:38:37.001367 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 14:38:37.001367 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 14:38:37.001367 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:38:37.001367 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Jul 26 14:38:37.001367 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 288/567] 10.222.0.93 () {56 vars in 1108 bytes} [Tue Jul 26 14:38:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:38:37.001367 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a87e42b-a1a5-452a-9166-febb26855e56 None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:37.149699 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39e7453-85ad-4ea0-9001-74f9dee1a82e None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:37.199573 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a87e42b-a1a5-452a-9166-febb26855e56 None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:37.214789 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a067c99-432e-4e2a-bdc2-6043697b745e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:37.215825 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a067c99-432e-4e2a-bdc2-6043697b745e None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:37.216273 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a067c99-432e-4e2a-bdc2-6043697b745e None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:37.216791 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a067c99-432e-4e2a-bdc2-6043697b745e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:37.234103 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a067c99-432e-4e2a-bdc2-6043697b745e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:38:37.236808 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a067c99-432e-4e2a-bdc2-6043697b745e None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:38:37.249657 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:38:37.263482 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a6f87c-436a-403e-8d55-3498da23100d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:37.264145 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a6f87c-436a-403e-8d55-3498da23100d None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:37.264426 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a6f87c-436a-403e-8d55-3498da23100d None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:37.264705 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a6f87c-436a-403e-8d55-3498da23100d None admin] PATH_INFO: `/v3/roles/service` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:37.265916 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application [None req-1a067c99-432e-4e2a-bdc2-6043697b745e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:38:37.265916 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:38:37.265916 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:38:37.265916 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:38:37.265916 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:38:37.265916 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:38:37.265916 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:38:37.265916 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:38:37.265916 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:38:37.265916 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:38:37.265916 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:38:37.265916 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:38:37.265916 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 14:38:37.265916 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 14:38:37.265916 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 14:38:37.267572 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 14:38:37.267572 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:38:37.267572 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:38:37.267572 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:38:37.267572 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:38:37.267572 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:38:37.267572 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:38:37.267572 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:38:37.267572 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application with Lock( Jul 26 14:38:37.267572 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:38:37.267572 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:38:37.267572 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:38:37.267572 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:38:37.267572 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:38:37.267572 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:38:37.267572 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:38:37.267572 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:38:37.269266 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 14:38:37.269266 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 14:38:37.269266 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:38:37.269266 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Jul 26 14:38:37.269266 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 280/568] 10.222.0.93 () {56 vars in 1108 bytes} [Tue Jul 26 14:38:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 334 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:38:37.271558 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a067c99-432e-4e2a-bdc2-6043697b745e None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:37.286784 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a6f87c-436a-403e-8d55-3498da23100d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 14:38:37.292628 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application [None req-32a6f87c-436a-403e-8d55-3498da23100d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 26 14:38:37.292628 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:38:37.292628 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:38:37.292628 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:38:37.292628 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:38:37.292628 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:38:37.292628 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:38:37.292628 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:38:37.292628 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:38:37.292628 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:38:37.292628 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:38:37.292628 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:38:37.292628 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 14:38:37.292628 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 14:38:37.292628 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 14:38:37.292628 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 14:38:37.295558 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 14:38:37.295558 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 14:38:37.295558 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 14:38:37.295558 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 14:38:37.295558 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:38:37.295558 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:38:37.295558 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:38:37.295558 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:38:37.295558 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:38:37.295558 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:38:37.295558 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:38:37.295558 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application with Lock( Jul 26 14:38:37.295558 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:38:37.295558 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:38:37.295558 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:38:37.295558 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:38:37.298440 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:38:37.298440 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:38:37.298440 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:38:37.298440 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:38:37.298440 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 14:38:37.298440 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 14:38:37.298440 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 14:38:37.298440 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 14:38:37.298440 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 14:38:37.298440 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 14:38:37.298440 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 26 14:38:37.298440 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Jul 26 14:38:37.298440 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 289/569] 10.222.0.93 () {56 vars in 1102 bytes} [Tue Jul 26 14:38:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:38:37.300608 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a6f87c-436a-403e-8d55-3498da23100d None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:37.388123 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:38:37.464086 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a067c99-432e-4e2a-bdc2-6043697b745e None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:37.464748 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a6f87c-436a-403e-8d55-3498da23100d None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:37.571644 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c6e1bd-e952-4ec7-96c9-b2bfcc880819 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:37.571644 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c6e1bd-e952-4ec7-96c9-b2bfcc880819 None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:37.571644 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c6e1bd-e952-4ec7-96c9-b2bfcc880819 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:37.571644 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c6e1bd-e952-4ec7-96c9-b2bfcc880819 None admin] PATH_INFO: `/v3/domains` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:37.572266 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c6e1bd-e952-4ec7-96c9-b2bfcc880819 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:38:37.572266 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c6e1bd-e952-4ec7-96c9-b2bfcc880819 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:38:37.572266 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c6e1bd-e952-4ec7-96c9-b2bfcc880819 None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:38:37.572621 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eca7005-8985-4137-bb39-545d68363aa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:37.572621 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eca7005-8985-4137-bb39-545d68363aa7 None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:37.572621 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eca7005-8985-4137-bb39-545d68363aa7 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:37.572621 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eca7005-8985-4137-bb39-545d68363aa7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:37.573109 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eca7005-8985-4137-bb39-545d68363aa7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:38:37.573109 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eca7005-8985-4137-bb39-545d68363aa7 None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:38:37.573403 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 290/570] 10.222.0.93 () {56 vars in 1109 bytes} [Tue Jul 26 14:38:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:38:37.573403 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c6e1bd-e952-4ec7-96c9-b2bfcc880819 None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:37.573727 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application [None req-3eca7005-8985-4137-bb39-545d68363aa7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 14:38:37.573727 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:38:37.573727 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:38:37.573727 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:38:37.573727 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:38:37.573727 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:38:37.573727 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:38:37.573727 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:38:37.573727 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:38:37.573727 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:38:37.573727 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:38:37.573727 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:38:37.573727 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 14:38:37.573727 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 14:38:37.573727 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 14:38:37.576506 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 14:38:37.576506 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:38:37.576506 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:38:37.576506 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:38:37.576506 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:38:37.576506 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:38:37.576506 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:38:37.576506 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:38:37.576506 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application with Lock( Jul 26 14:38:37.576506 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:38:37.576506 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:38:37.576506 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:38:37.576506 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:38:37.576506 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:38:37.576506 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:38:37.576506 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:38:37.576506 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:38:37.579930 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 14:38:37.579930 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 14:38:37.579930 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 14:38:37.579930 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 14:38:37.579930 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 14:38:37.579930 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 14:38:37.579930 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 14:38:37.579930 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Jul 26 14:38:37.579930 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 281/571] 10.222.0.93 () {56 vars in 1111 bytes} [Tue Jul 26 14:38:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:38:37.579930 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eca7005-8985-4137-bb39-545d68363aa7 None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:37.637345 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:38:37.726603 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c6e1bd-e952-4ec7-96c9-b2bfcc880819 None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:37.789357 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04468f72-02b9-4fa0-b5de-342a258f48bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:37.790165 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04468f72-02b9-4fa0-b5de-342a258f48bb None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:37.790645 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04468f72-02b9-4fa0-b5de-342a258f48bb None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:37.791093 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04468f72-02b9-4fa0-b5de-342a258f48bb None admin] PATH_INFO: `/v3/domains` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:37.792183 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04468f72-02b9-4fa0-b5de-342a258f48bb None admin] RBAC: Adding query filter params (name=Default) {{(pid=87056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:38:37.792691 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04468f72-02b9-4fa0-b5de-342a258f48bb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:38:37.794446 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eca7005-8985-4137-bb39-545d68363aa7 None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:37.795151 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04468f72-02b9-4fa0-b5de-342a258f48bb None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:38:37.826097 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 291/572] 10.222.0.93 () {56 vars in 1109 bytes} [Tue Jul 26 14:38:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:38:37.826097 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04468f72-02b9-4fa0-b5de-342a258f48bb None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:37.846231 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:38:37.863462 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2225c5c1-8447-46b8-a871-a4dd0a83a9ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:37.864658 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2225c5c1-8447-46b8-a871-a4dd0a83a9ab None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:37.865111 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2225c5c1-8447-46b8-a871-a4dd0a83a9ab None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:37.865817 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2225c5c1-8447-46b8-a871-a4dd0a83a9ab None admin] PATH_INFO: `/v3/roles` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:37.867617 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2225c5c1-8447-46b8-a871-a4dd0a83a9ab None admin] RBAC: Adding query filter params (name=service) {{(pid=87055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:38:37.871534 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2225c5c1-8447-46b8-a871-a4dd0a83a9ab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:38:37.871534 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2225c5c1-8447-46b8-a871-a4dd0a83a9ab None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:38:37.885686 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 282/573] 10.222.0.93 () {56 vars in 1103 bytes} [Tue Jul 26 14:38:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:38:37.887777 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2225c5c1-8447-46b8-a871-a4dd0a83a9ab None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:38.000486 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04468f72-02b9-4fa0-b5de-342a258f48bb None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:38.011852 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:38:38.030001 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2225c5c1-8447-46b8-a871-a4dd0a83a9ab None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:38.048285 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf36801-2860-4f52-94f6-065dff07c5be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:38.048953 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf36801-2860-4f52-94f6-065dff07c5be None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:38.049351 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf36801-2860-4f52-94f6-065dff07c5be None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:38.049538 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf36801-2860-4f52-94f6-065dff07c5be None admin] PATH_INFO: `/v3/projects/service` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:38.058387 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf36801-2860-4f52-94f6-065dff07c5be None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:38:38.059908 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf36801-2860-4f52-94f6-065dff07c5be None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:38:38.073074 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application [None req-fbf36801-2860-4f52-94f6-065dff07c5be None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 14:38:38.073074 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:38:38.073074 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:38:38.073074 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:38:38.073074 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:38:38.073074 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:38:38.073074 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:38:38.073074 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:38:38.073074 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:38:38.073074 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:38:38.073074 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:38:38.073074 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:38:38.073074 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 14:38:38.073074 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 14:38:38.073074 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 14:38:38.074870 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 14:38:38.074870 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:38:38.074870 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:38:38.074870 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:38:38.074870 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:38:38.074870 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:38:38.074870 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:38:38.074870 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:38:38.074870 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application with Lock( Jul 26 14:38:38.074870 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:38:38.074870 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:38:38.074870 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:38:38.074870 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:38:38.074870 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:38:38.074870 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:38:38.074870 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:38:38.074870 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:38:38.076730 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 14:38:38.076730 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 14:38:38.076730 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 14:38:38.076730 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 14:38:38.076730 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 14:38:38.076730 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 14:38:38.076730 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 14:38:38.076730 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Jul 26 14:38:38.076730 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 292/574] 10.222.0.93 () {56 vars in 1111 bytes} [Tue Jul 26 14:38:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:38:38.076730 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf36801-2860-4f52-94f6-065dff07c5be None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:38.083724 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cf73cb-aab7-4fa0-8d86-75b16fec655b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:38.085086 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cf73cb-aab7-4fa0-8d86-75b16fec655b None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:38.085365 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cf73cb-aab7-4fa0-8d86-75b16fec655b None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:38.085614 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cf73cb-aab7-4fa0-8d86-75b16fec655b None admin] PATH_INFO: `/v3/projects` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:38.086156 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cf73cb-aab7-4fa0-8d86-75b16fec655b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:38:38.086514 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cf73cb-aab7-4fa0-8d86-75b16fec655b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:38:38.087988 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cf73cb-aab7-4fa0-8d86-75b16fec655b None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:38:38.103634 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 283/575] 10.222.0.93 () {56 vars in 1148 bytes} [Tue Jul 26 14:38:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:38:38.104609 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cf73cb-aab7-4fa0-8d86-75b16fec655b None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:38.173032 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:38:38.207515 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf36801-2860-4f52-94f6-065dff07c5be None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:38.244796 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cf73cb-aab7-4fa0-8d86-75b16fec655b None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:38.251998 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338b2dcd-08a5-4ad2-b92b-5bec912a823a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:38.252675 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338b2dcd-08a5-4ad2-b92b-5bec912a823a None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:38.252964 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338b2dcd-08a5-4ad2-b92b-5bec912a823a None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:38.253870 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338b2dcd-08a5-4ad2-b92b-5bec912a823a None admin] PATH_INFO: `/v3/users/nova` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:38.263153 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338b2dcd-08a5-4ad2-b92b-5bec912a823a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:38:38.264641 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338b2dcd-08a5-4ad2-b92b-5bec912a823a None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:38:38.277186 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application [None req-338b2dcd-08a5-4ad2-b92b-5bec912a823a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 26 14:38:38.277186 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:38:38.277186 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:38:38.277186 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:38:38.277186 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:38:38.277186 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:38:38.277186 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:38:38.277186 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:38:38.277186 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:38:38.277186 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:38:38.277186 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:38:38.277186 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:38:38.277186 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 14:38:38.277186 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 14:38:38.277186 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 14:38:38.277186 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 14:38:38.278965 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:38:38.278965 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:38:38.278965 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 14:38:38.278965 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 14:38:38.278965 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 14:38:38.278965 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 14:38:38.278965 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:38:38.278965 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:38:38.278965 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:38:38.278965 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:38:38.278965 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:38:38.278965 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application with Lock( Jul 26 14:38:38.278965 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:38:38.278965 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:38:38.278965 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:38:38.278965 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:38:38.278965 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:38:38.278965 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:38:38.280751 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:38:38.280751 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:38:38.280751 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 14:38:38.280751 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 14:38:38.280751 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 14:38:38.280751 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 14:38:38.280751 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 14:38:38.280751 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 14:38:38.280751 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 26 14:38:38.280751 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Jul 26 14:38:38.280751 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 293/576] 10.222.0.93 () {56 vars in 1093 bytes} [Tue Jul 26 14:38:38 2022] GET /identity/v3/users/nova => generated 82 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:38:38.280751 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338b2dcd-08a5-4ad2-b92b-5bec912a823a None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:38.295230 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3a16bd-5ccf-42b2-9daa-4d29ed7c916d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:38.296057 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3a16bd-5ccf-42b2-9daa-4d29ed7c916d None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:38.296376 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3a16bd-5ccf-42b2-9daa-4d29ed7c916d None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:38.296694 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3a16bd-5ccf-42b2-9daa-4d29ed7c916d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:38.312026 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3a16bd-5ccf-42b2-9daa-4d29ed7c916d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:38:38.313537 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3a16bd-5ccf-42b2-9daa-4d29ed7c916d None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:38:38.315194 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:38:38.337463 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application [None req-ac3a16bd-5ccf-42b2-9daa-4d29ed7c916d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:38:38.337463 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:38:38.337463 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:38:38.337463 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:38:38.337463 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:38:38.337463 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:38:38.337463 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:38:38.337463 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:38:38.337463 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:38:38.337463 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:38:38.337463 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:38:38.337463 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:38:38.337463 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 14:38:38.337463 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 14:38:38.337463 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 14:38:38.338676 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 14:38:38.338676 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:38:38.338676 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:38:38.338676 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:38:38.338676 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:38:38.338676 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:38:38.338676 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:38:38.338676 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:38:38.338676 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application with Lock( Jul 26 14:38:38.338676 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:38:38.338676 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:38:38.338676 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:38:38.338676 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:38:38.338676 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:38:38.338676 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:38:38.338676 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:38:38.338676 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:38:38.344598 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 14:38:38.344598 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 14:38:38.344598 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:38:38.344598 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Jul 26 14:38:38.344598 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 284/577] 10.222.0.93 () {56 vars in 1108 bytes} [Tue Jul 26 14:38:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:38:38.344598 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3a16bd-5ccf-42b2-9daa-4d29ed7c916d None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:38.414564 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338b2dcd-08a5-4ad2-b92b-5bec912a823a None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:38.454903 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb6f08d-f00a-4380-8567-35ae6ecd5fd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:38.455537 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb6f08d-f00a-4380-8567-35ae6ecd5fd2 None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:38.455820 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb6f08d-f00a-4380-8567-35ae6ecd5fd2 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:38.456209 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb6f08d-f00a-4380-8567-35ae6ecd5fd2 None admin] PATH_INFO: `/v3/projects` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:38.456852 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb6f08d-f00a-4380-8567-35ae6ecd5fd2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:38:38.457157 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb6f08d-f00a-4380-8567-35ae6ecd5fd2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:38:38.458690 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb6f08d-f00a-4380-8567-35ae6ecd5fd2 None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:38:38.470168 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:38:38.472162 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 294/578] 10.222.0.93 () {56 vars in 1148 bytes} [Tue Jul 26 14:38:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:38:38.473654 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2d5fe4-b7c3-42e8-b55f-992daadb2311 None None] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:38.473943 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2d5fe4-b7c3-42e8-b55f-992daadb2311 None None] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:38.474340 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2d5fe4-b7c3-42e8-b55f-992daadb2311 None None] PATH_INFO: `/` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:38.481981 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3a16bd-5ccf-42b2-9daa-4d29ed7c916d None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:38.482187 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 295/579] 10.222.0.93 () {54 vars in 926 bytes} [Tue Jul 26 14:38:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:38:38.482187 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2d5fe4-b7c3-42e8-b55f-992daadb2311 None None] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:38.519820 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8c1f4b-bbe9-45f5-9152-542e0798c67a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:38.520445 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8c1f4b-bbe9-45f5-9152-542e0798c67a None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:38.520725 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8c1f4b-bbe9-45f5-9152-542e0798c67a None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:38.521074 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8c1f4b-bbe9-45f5-9152-542e0798c67a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:38.522308 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8c1f4b-bbe9-45f5-9152-542e0798c67a None admin] RBAC: Adding query filter params (role.id=2e45ca312cda4bef9263725ae1c6dab7, scope.project.id=c422a2290a14424da20e2841cbc1741d, user.id=b914b2ba87e74def85f9694e1141e00b) {{(pid=87055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:38:38.522634 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8c1f4b-bbe9-45f5-9152-542e0798c67a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:38:38.524164 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8c1f4b-bbe9-45f5-9152-542e0798c67a None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:38:38.530570 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 285/580] 10.222.0.93 () {56 vars in 1374 bytes} [Tue Jul 26 14:38:38 2022] GET /identity/v3/role_assignments?user.id=b914b2ba87e74def85f9694e1141e00b&scope.project.id=c422a2290a14424da20e2841cbc1741d&role.id=2e45ca312cda4bef9263725ae1c6dab7 => generated 259 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:38:38.531444 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8c1f4b-bbe9-45f5-9152-542e0798c67a None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:38.609720 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:38:38.638175 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2d5fe4-b7c3-42e8-b55f-992daadb2311 None None] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:38.692964 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965c1916-386f-4602-b2d1-d390921c251f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:38.693766 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965c1916-386f-4602-b2d1-d390921c251f None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:38.694235 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965c1916-386f-4602-b2d1-d390921c251f None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:38.694699 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965c1916-386f-4602-b2d1-d390921c251f None admin] PATH_INFO: `/v3/users` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:38.696211 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965c1916-386f-4602-b2d1-d390921c251f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:38:38.696713 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965c1916-386f-4602-b2d1-d390921c251f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:38:38.699439 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965c1916-386f-4602-b2d1-d390921c251f None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:38:38.720503 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8c1f4b-bbe9-45f5-9152-542e0798c67a None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:38.729073 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 296/581] 10.222.0.93 () {56 vars in 1133 bytes} [Tue Jul 26 14:38:38 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:38:38.729940 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965c1916-386f-4602-b2d1-d390921c251f None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:38.771657 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8b73b0-ec01-4727-8e3b-53c0010b01a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:38.772355 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8b73b0-ec01-4727-8e3b-53c0010b01a3 None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:38.772639 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8b73b0-ec01-4727-8e3b-53c0010b01a3 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:38.772919 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8b73b0-ec01-4727-8e3b-53c0010b01a3 None admin] PATH_INFO: `/v3/domains` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:38.773640 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8b73b0-ec01-4727-8e3b-53c0010b01a3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:38:38.773950 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8b73b0-ec01-4727-8e3b-53c0010b01a3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:38:38.775661 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8b73b0-ec01-4727-8e3b-53c0010b01a3 None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:38:38.792675 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 286/582] 10.222.0.93 () {56 vars in 1109 bytes} [Tue Jul 26 14:38:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:38:38.796689 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506dc06e-06f9-4b4e-9c8e-d625fc7e28ce None None] REQUEST_METHOD: `POST` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:38.797575 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506dc06e-06f9-4b4e-9c8e-d625fc7e28ce None None] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:38.798062 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506dc06e-06f9-4b4e-9c8e-d625fc7e28ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:38.830894 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.auth.core [None req-506dc06e-06f9-4b4e-9c8e-d625fc7e28ce None None] MFA Rules not processed for user `e5ef88cc058f425b882bcb87a1e1e75c`. Rule list: `[]` (Enabled: `True`). {{(pid=87055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:38:38.832144 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.fernet_utils [None req-506dc06e-06f9-4b4e-9c8e-d625fc7e28ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:38:38.854333 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:38:38.889277 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965c1916-386f-4602-b2d1-d390921c251f None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:38.926507 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 287/583] 10.222.0.93 () {58 vars in 1023 bytes} [Tue Jul 26 14:38:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 14:38:38.926507 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506dc06e-06f9-4b4e-9c8e-d625fc7e28ce None None] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:38.958788 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e0fd94-a9fb-4664-8a54-a3603f0f2027 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:38.959776 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e0fd94-a9fb-4664-8a54-a3603f0f2027 None admin] REQUEST_METHOD: `PUT` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:38.960090 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e0fd94-a9fb-4664-8a54-a3603f0f2027 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:38.960443 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e0fd94-a9fb-4664-8a54-a3603f0f2027 None admin] PATH_INFO: `/v3/projects/c422a2290a14424da20e2841cbc1741d/users/38ab40a64fb7419ebb0476e0fa09a2bb/roles/2e45ca312cda4bef9263725ae1c6dab7` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:38.982164 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e0fd94-a9fb-4664-8a54-a3603f0f2027 None admin] RBAC: Authorizing `identity:create_grant(project_id=c422a2290a14424da20e2841cbc1741d, user_id=38ab40a64fb7419ebb0476e0fa09a2bb, role_id=2e45ca312cda4bef9263725ae1c6dab7)` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:38:38.983796 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e0fd94-a9fb-4664-8a54-a3603f0f2027 None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:38:38.986465 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:38:39.103854 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506dc06e-06f9-4b4e-9c8e-d625fc7e28ce None None] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:39.132013 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 297/584] 10.222.0.93 () {58 vars in 1439 bytes} [Tue Jul 26 14:38:38 2022] PUT /identity/v3/projects/c422a2290a14424da20e2841cbc1741d/users/38ab40a64fb7419ebb0476e0fa09a2bb/roles/2e45ca312cda4bef9263725ae1c6dab7 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 14:38:39.134122 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e0fd94-a9fb-4664-8a54-a3603f0f2027 None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:39.174416 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaeb2cdc-e23d-4dfe-8741-0661fc43e181 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:39.176673 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaeb2cdc-e23d-4dfe-8741-0661fc43e181 None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:39.177648 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaeb2cdc-e23d-4dfe-8741-0661fc43e181 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:39.179007 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaeb2cdc-e23d-4dfe-8741-0661fc43e181 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:39.203458 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaeb2cdc-e23d-4dfe-8741-0661fc43e181 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:38:39.207479 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaeb2cdc-e23d-4dfe-8741-0661fc43e181 None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:38:39.247430 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application [None req-eaeb2cdc-e23d-4dfe-8741-0661fc43e181 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:38:39.247430 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:38:39.247430 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:38:39.247430 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:38:39.247430 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:38:39.247430 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:38:39.247430 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:38:39.247430 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:38:39.247430 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:38:39.247430 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:38:39.247430 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:38:39.247430 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:38:39.247430 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 14:38:39.247430 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 14:38:39.247430 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 14:38:39.249106 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 14:38:39.249106 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:38:39.249106 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:38:39.249106 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:38:39.249106 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:38:39.249106 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:38:39.249106 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:38:39.249106 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:38:39.249106 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application with Lock( Jul 26 14:38:39.249106 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:38:39.249106 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:38:39.249106 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:38:39.249106 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:38:39.249106 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:38:39.249106 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:38:39.249106 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:38:39.249106 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:38:39.251558 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 14:38:39.251558 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 14:38:39.251558 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:38:39.251558 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Jul 26 14:38:39.251558 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 288/585] 10.222.0.93 () {56 vars in 1108 bytes} [Tue Jul 26 14:38:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 328 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:38:39.251558 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaeb2cdc-e23d-4dfe-8741-0661fc43e181 None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:39.263907 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:38:39.336220 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e0fd94-a9fb-4664-8a54-a3603f0f2027 None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:39.411193 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e93c19-1682-44ab-abac-62e157c4c131 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:39.412863 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e93c19-1682-44ab-abac-62e157c4c131 None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:39.413439 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e93c19-1682-44ab-abac-62e157c4c131 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:39.413729 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e93c19-1682-44ab-abac-62e157c4c131 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:39.432736 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e93c19-1682-44ab-abac-62e157c4c131 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:38:39.436741 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e93c19-1682-44ab-abac-62e157c4c131 None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:38:39.448594 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaeb2cdc-e23d-4dfe-8741-0661fc43e181 None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:39.468439 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application [None req-44e93c19-1682-44ab-abac-62e157c4c131 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 26 14:38:39.468439 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:38:39.468439 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:38:39.468439 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:38:39.468439 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:38:39.468439 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:38:39.468439 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:38:39.468439 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:38:39.468439 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:38:39.468439 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:38:39.468439 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:38:39.468439 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:38:39.468439 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 14:38:39.468439 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 14:38:39.468439 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 14:38:39.468439 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 14:38:39.470552 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:38:39.470552 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:38:39.470552 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 14:38:39.470552 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 14:38:39.470552 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 14:38:39.470552 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 14:38:39.470552 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:38:39.470552 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:38:39.470552 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:38:39.470552 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:38:39.470552 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:38:39.470552 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application with Lock( Jul 26 14:38:39.470552 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:38:39.470552 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:38:39.470552 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:38:39.470552 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:38:39.470552 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:38:39.470552 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:38:39.472477 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:38:39.472477 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:38:39.472477 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 14:38:39.472477 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 14:38:39.472477 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 14:38:39.472477 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 14:38:39.472477 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 14:38:39.472477 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 14:38:39.472477 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 26 14:38:39.472477 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Jul 26 14:38:39.472477 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 298/586] 10.222.0.93 () {56 vars in 1099 bytes} [Tue Jul 26 14:38:39 2022] GET /identity/v3/users/cinder => generated 84 bytes in 338 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:38:39.473581 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e93c19-1682-44ab-abac-62e157c4c131 None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:39.518543 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f92175-d347-4250-a0f7-28724c4af3b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:39.519989 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f92175-d347-4250-a0f7-28724c4af3b9 None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:39.520475 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f92175-d347-4250-a0f7-28724c4af3b9 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:39.521655 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f92175-d347-4250-a0f7-28724c4af3b9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:39.548448 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f92175-d347-4250-a0f7-28724c4af3b9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 14:38:39.554969 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application [None req-26f92175-d347-4250-a0f7-28724c4af3b9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 26 14:38:39.554969 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:38:39.554969 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:38:39.554969 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:38:39.554969 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:38:39.554969 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:38:39.554969 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:38:39.554969 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:38:39.554969 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:38:39.554969 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:38:39.554969 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:38:39.554969 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:38:39.554969 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 14:38:39.554969 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 14:38:39.554969 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 14:38:39.554969 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 14:38:39.556976 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 14:38:39.556976 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 14:38:39.556976 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 14:38:39.556976 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 14:38:39.556976 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:38:39.556976 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:38:39.556976 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:38:39.556976 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:38:39.556976 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:38:39.556976 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:38:39.556976 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:38:39.556976 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application with Lock( Jul 26 14:38:39.556976 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:38:39.556976 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:38:39.556976 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:38:39.556976 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:38:39.559423 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:38:39.559423 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:38:39.559423 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:38:39.559423 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:38:39.559423 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 14:38:39.559423 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 14:38:39.559423 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 14:38:39.559423 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 14:38:39.559423 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 14:38:39.559423 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 14:38:39.559423 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 26 14:38:39.559423 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Jul 26 14:38:39.559423 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 289/587] 10.222.0.93 () {56 vars in 1102 bytes} [Tue Jul 26 14:38:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:38:39.567016 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f92175-d347-4250-a0f7-28724c4af3b9 None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:39.567260 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:38:39.655008 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e93c19-1682-44ab-abac-62e157c4c131 None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:39.670489 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:38:39.705872 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c572ed-7bc6-4d40-a96f-b4c8bfb03cc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:39.706930 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c572ed-7bc6-4d40-a96f-b4c8bfb03cc9 None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:39.707371 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c572ed-7bc6-4d40-a96f-b4c8bfb03cc9 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:39.707802 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c572ed-7bc6-4d40-a96f-b4c8bfb03cc9 None admin] PATH_INFO: `/v3/domains` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:39.708715 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c572ed-7bc6-4d40-a96f-b4c8bfb03cc9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:38:39.709209 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c572ed-7bc6-4d40-a96f-b4c8bfb03cc9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:38:39.711814 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c572ed-7bc6-4d40-a96f-b4c8bfb03cc9 None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:38:39.732162 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 299/588] 10.222.0.93 () {56 vars in 1109 bytes} [Tue Jul 26 14:38:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:38:39.733580 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c572ed-7bc6-4d40-a96f-b4c8bfb03cc9 None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:39.748885 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f92175-d347-4250-a0f7-28724c4af3b9 None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:39.814557 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f548558-8fc2-4b9f-8a96-55373d56264e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:39.815951 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f548558-8fc2-4b9f-8a96-55373d56264e None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:39.816071 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f548558-8fc2-4b9f-8a96-55373d56264e None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:39.816536 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f548558-8fc2-4b9f-8a96-55373d56264e None admin] PATH_INFO: `/v3/users` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:39.818043 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f548558-8fc2-4b9f-8a96-55373d56264e None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=87055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:38:39.818869 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f548558-8fc2-4b9f-8a96-55373d56264e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:38:39.821816 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f548558-8fc2-4b9f-8a96-55373d56264e None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:38:39.862553 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 290/589] 10.222.0.93 () {56 vars in 1137 bytes} [Tue Jul 26 14:38:39 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:38:39.862553 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f548558-8fc2-4b9f-8a96-55373d56264e None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:39.862835 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c572ed-7bc6-4d40-a96f-b4c8bfb03cc9 None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:39.901451 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:38:39.943123 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d0e8a8-f0d4-477f-90dc-99f10c9b2008 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:39.945333 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d0e8a8-f0d4-477f-90dc-99f10c9b2008 None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:39.946185 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d0e8a8-f0d4-477f-90dc-99f10c9b2008 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:39.947102 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d0e8a8-f0d4-477f-90dc-99f10c9b2008 None admin] PATH_INFO: `/v3/roles` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:39.948764 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d0e8a8-f0d4-477f-90dc-99f10c9b2008 None admin] RBAC: Adding query filter params (name=service) {{(pid=87056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:38:39.949795 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d0e8a8-f0d4-477f-90dc-99f10c9b2008 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:38:39.952948 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d0e8a8-f0d4-477f-90dc-99f10c9b2008 None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:38:39.967515 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 300/590] 10.222.0.93 () {56 vars in 1103 bytes} [Tue Jul 26 14:38:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:38:39.968840 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d0e8a8-f0d4-477f-90dc-99f10c9b2008 None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:40.078375 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f548558-8fc2-4b9f-8a96-55373d56264e None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:40.095640 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d0e8a8-f0d4-477f-90dc-99f10c9b2008 None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:40.123853 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:38:40.138641 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754375e2-727c-408e-9335-8f218e39b348 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:40.139964 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754375e2-727c-408e-9335-8f218e39b348 None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:40.140460 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754375e2-727c-408e-9335-8f218e39b348 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:40.140977 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754375e2-727c-408e-9335-8f218e39b348 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:40.145403 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909edad8-25d0-4805-968b-c6c5c28fbd02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:40.146549 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909edad8-25d0-4805-968b-c6c5c28fbd02 None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:40.147248 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909edad8-25d0-4805-968b-c6c5c28fbd02 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:40.147768 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909edad8-25d0-4805-968b-c6c5c28fbd02 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:40.160066 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754375e2-727c-408e-9335-8f218e39b348 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:38:40.161523 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909edad8-25d0-4805-968b-c6c5c28fbd02 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:38:40.162919 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754375e2-727c-408e-9335-8f218e39b348 None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:38:40.164910 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909edad8-25d0-4805-968b-c6c5c28fbd02 None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:38:40.182753 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application [None req-754375e2-727c-408e-9335-8f218e39b348 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:38:40.182753 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:38:40.182753 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:38:40.182753 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:38:40.182753 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:38:40.182753 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:38:40.182753 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:38:40.182753 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:38:40.182753 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:38:40.182753 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:38:40.182753 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:38:40.182753 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:38:40.182753 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 14:38:40.182753 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 14:38:40.182753 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 14:38:40.183740 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 14:38:40.183740 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:38:40.183740 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:38:40.183740 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:38:40.183740 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:38:40.183740 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:38:40.183740 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:38:40.183740 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:38:40.183740 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application with Lock( Jul 26 14:38:40.183740 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:38:40.183740 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:38:40.183740 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:38:40.183740 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:38:40.183740 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:38:40.183740 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:38:40.183740 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:38:40.183740 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:38:40.184647 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 14:38:40.184647 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 14:38:40.184647 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:38:40.184647 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Jul 26 14:38:40.191489 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application [None req-909edad8-25d0-4805-968b-c6c5c28fbd02 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 14:38:40.191489 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:38:40.191489 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:38:40.191489 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:38:40.191489 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:38:40.191489 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:38:40.191489 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:38:40.191489 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:38:40.191489 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:38:40.191489 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:38:40.191489 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:38:40.191489 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:38:40.191489 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 14:38:40.191489 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 14:38:40.191489 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 14:38:40.192438 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 14:38:40.192438 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:38:40.192438 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:38:40.192438 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:38:40.192438 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:38:40.192438 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:38:40.192438 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:38:40.192438 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:38:40.192438 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application with Lock( Jul 26 14:38:40.192438 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:38:40.192438 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:38:40.192438 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:38:40.192438 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:38:40.192438 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:38:40.192438 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:38:40.192438 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:38:40.192438 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:38:40.193378 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 14:38:40.193378 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 14:38:40.193378 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 14:38:40.193378 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 14:38:40.193378 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 14:38:40.193378 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 14:38:40.193378 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 14:38:40.193378 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Jul 26 14:38:40.194572 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 301/592] 10.222.0.93 () {56 vars in 1108 bytes} [Tue Jul 26 14:38:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:38:40.195888 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754375e2-727c-408e-9335-8f218e39b348 None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:40.198417 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 291/592] 10.222.0.93 () {56 vars in 1111 bytes} [Tue Jul 26 14:38:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 333 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:38:40.201909 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909edad8-25d0-4805-968b-c6c5c28fbd02 None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:40.234772 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:38:40.345066 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754375e2-727c-408e-9335-8f218e39b348 None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:40.426909 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f56e36-fde7-4cc9-8ec8-0ca2eb70c671 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:40.430071 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f56e36-fde7-4cc9-8ec8-0ca2eb70c671 None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:40.431550 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f56e36-fde7-4cc9-8ec8-0ca2eb70c671 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:40.432373 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f56e36-fde7-4cc9-8ec8-0ca2eb70c671 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:40.455296 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909edad8-25d0-4805-968b-c6c5c28fbd02 None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:40.468062 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f56e36-fde7-4cc9-8ec8-0ca2eb70c671 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:38:40.471115 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f56e36-fde7-4cc9-8ec8-0ca2eb70c671 None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:38:40.517866 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application [None req-08f56e36-fde7-4cc9-8ec8-0ca2eb70c671 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:38:40.517866 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:38:40.517866 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:38:40.517866 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:38:40.517866 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:38:40.517866 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:38:40.517866 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:38:40.517866 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:38:40.517866 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:38:40.517866 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:38:40.517866 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:38:40.517866 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:38:40.517866 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 14:38:40.517866 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 14:38:40.517866 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 14:38:40.518888 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 14:38:40.518888 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:38:40.518888 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:38:40.518888 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:38:40.518888 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:38:40.518888 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:38:40.518888 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:38:40.518888 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:38:40.518888 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application with Lock( Jul 26 14:38:40.518888 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:38:40.518888 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:38:40.518888 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:38:40.518888 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:38:40.518888 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:38:40.518888 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:38:40.518888 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:38:40.518888 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:38:40.519787 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 14:38:40.519787 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 14:38:40.519787 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:38:40.519787 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Jul 26 14:38:40.522416 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 302/593] 10.222.0.93 () {56 vars in 1108 bytes} [Tue Jul 26 14:38:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 326 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:38:40.524145 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f56e36-fde7-4cc9-8ec8-0ca2eb70c671 None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:40.529153 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49054ee5-9c06-4cf2-844a-a8eb81ac9fb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:40.531773 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49054ee5-9c06-4cf2-844a-a8eb81ac9fb7 None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:40.532271 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49054ee5-9c06-4cf2-844a-a8eb81ac9fb7 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:40.532788 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49054ee5-9c06-4cf2-844a-a8eb81ac9fb7 None admin] PATH_INFO: `/v3/domains` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:40.534101 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49054ee5-9c06-4cf2-844a-a8eb81ac9fb7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:38:40.534777 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49054ee5-9c06-4cf2-844a-a8eb81ac9fb7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:38:40.537128 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49054ee5-9c06-4cf2-844a-a8eb81ac9fb7 None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:38:40.555405 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 292/594] 10.222.0.93 () {56 vars in 1109 bytes} [Tue Jul 26 14:38:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 356 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:38:40.556357 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49054ee5-9c06-4cf2-844a-a8eb81ac9fb7 None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:40.609344 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:38:40.701177 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:38:40.702170 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49054ee5-9c06-4cf2-844a-a8eb81ac9fb7 None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:40.743003 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f56e36-fde7-4cc9-8ec8-0ca2eb70c671 None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:40.769325 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc2fcd9-e74d-40f3-a599-590e18865958 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:40.770449 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc2fcd9-e74d-40f3-a599-590e18865958 None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:40.770940 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc2fcd9-e74d-40f3-a599-590e18865958 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:40.771423 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc2fcd9-e74d-40f3-a599-590e18865958 None admin] PATH_INFO: `/v3/domains` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:40.772986 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc2fcd9-e74d-40f3-a599-590e18865958 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:38:40.773547 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc2fcd9-e74d-40f3-a599-590e18865958 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:38:40.776266 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc2fcd9-e74d-40f3-a599-590e18865958 None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:38:40.800747 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 293/595] 10.222.0.93 () {56 vars in 1109 bytes} [Tue Jul 26 14:38:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:38:40.802386 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc2fcd9-e74d-40f3-a599-590e18865958 None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:40.817550 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e95c0c7-8aad-4715-a807-99ac4c9dd3c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:40.819135 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e95c0c7-8aad-4715-a807-99ac4c9dd3c7 None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:40.819855 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e95c0c7-8aad-4715-a807-99ac4c9dd3c7 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:40.820569 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e95c0c7-8aad-4715-a807-99ac4c9dd3c7 None admin] PATH_INFO: `/v3/projects` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:40.822415 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e95c0c7-8aad-4715-a807-99ac4c9dd3c7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:38:40.823242 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e95c0c7-8aad-4715-a807-99ac4c9dd3c7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:38:40.826184 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e95c0c7-8aad-4715-a807-99ac4c9dd3c7 None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:38:40.857934 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 303/596] 10.222.0.93 () {56 vars in 1148 bytes} [Tue Jul 26 14:38:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:38:40.860623 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e95c0c7-8aad-4715-a807-99ac4c9dd3c7 None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:41.001254 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc2fcd9-e74d-40f3-a599-590e18865958 None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:41.004327 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:38:41.061460 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e95c0c7-8aad-4715-a807-99ac4c9dd3c7 None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:41.072196 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73290d8-9527-4395-8fa9-9c0efad4d1bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:41.072823 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73290d8-9527-4395-8fa9-9c0efad4d1bb None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:41.073315 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73290d8-9527-4395-8fa9-9c0efad4d1bb None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:41.073795 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73290d8-9527-4395-8fa9-9c0efad4d1bb None admin] PATH_INFO: `/v3/projects/service` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:41.088121 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73290d8-9527-4395-8fa9-9c0efad4d1bb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:38:41.090947 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73290d8-9527-4395-8fa9-9c0efad4d1bb None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:38:41.108862 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8275d2c-3762-471e-8c2b-d36a6bc95943 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:41.109838 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8275d2c-3762-471e-8c2b-d36a6bc95943 None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:41.110324 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8275d2c-3762-471e-8c2b-d36a6bc95943 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:41.110754 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8275d2c-3762-471e-8c2b-d36a6bc95943 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:41.117790 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application [None req-d73290d8-9527-4395-8fa9-9c0efad4d1bb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 14:38:41.117790 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:38:41.117790 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:38:41.117790 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:38:41.117790 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:38:41.117790 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:38:41.117790 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:38:41.117790 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:38:41.117790 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:38:41.117790 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:38:41.117790 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:38:41.117790 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:38:41.117790 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 14:38:41.117790 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 14:38:41.117790 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 14:38:41.118980 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 14:38:41.118980 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:38:41.118980 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:38:41.118980 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:38:41.118980 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:38:41.118980 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:38:41.118980 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:38:41.118980 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:38:41.118980 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application with Lock( Jul 26 14:38:41.118980 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:38:41.118980 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:38:41.118980 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:38:41.118980 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:38:41.118980 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:38:41.118980 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:38:41.118980 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:38:41.118980 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:38:41.120061 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 14:38:41.120061 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 14:38:41.120061 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 14:38:41.120061 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 14:38:41.120061 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 14:38:41.120061 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 14:38:41.120061 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 14:38:41.120061 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Jul 26 14:38:41.120620 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 294/597] 10.222.0.93 () {56 vars in 1111 bytes} [Tue Jul 26 14:38:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 319 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:38:41.121575 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73290d8-9527-4395-8fa9-9c0efad4d1bb None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:41.124643 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8275d2c-3762-471e-8c2b-d36a6bc95943 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:38:41.127815 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8275d2c-3762-471e-8c2b-d36a6bc95943 None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:38:41.132944 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:38:41.146441 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application [None req-d8275d2c-3762-471e-8c2b-d36a6bc95943 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 26 14:38:41.146441 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:38:41.146441 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:38:41.146441 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:38:41.146441 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:38:41.146441 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:38:41.146441 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:38:41.146441 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:38:41.146441 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:38:41.146441 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:38:41.146441 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:38:41.146441 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:38:41.146441 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 14:38:41.146441 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 14:38:41.146441 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 14:38:41.146441 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 14:38:41.148166 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:38:41.148166 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:38:41.148166 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 14:38:41.148166 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 14:38:41.148166 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 14:38:41.148166 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 14:38:41.148166 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:38:41.148166 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:38:41.148166 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:38:41.148166 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:38:41.148166 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:38:41.148166 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application with Lock( Jul 26 14:38:41.148166 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:38:41.148166 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:38:41.148166 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:38:41.148166 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:38:41.148166 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:38:41.148166 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:38:41.149097 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:38:41.149097 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:38:41.149097 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 14:38:41.149097 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 14:38:41.149097 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 14:38:41.149097 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 14:38:41.149097 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 14:38:41.149097 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 14:38:41.149097 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 26 14:38:41.149097 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Jul 26 14:38:41.151377 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 304/598] 10.222.0.93 () {56 vars in 1102 bytes} [Tue Jul 26 14:38:40 2022] GET /identity/v3/users/neutron => generated 85 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:38:41.152538 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8275d2c-3762-471e-8c2b-d36a6bc95943 None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:41.285374 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8275d2c-3762-471e-8c2b-d36a6bc95943 None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:41.321876 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73290d8-9527-4395-8fa9-9c0efad4d1bb None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:41.328885 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778d15a5-9bb0-4ec9-9071-3a06b1343d81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:41.329829 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778d15a5-9bb0-4ec9-9071-3a06b1343d81 None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:41.330314 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778d15a5-9bb0-4ec9-9071-3a06b1343d81 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:41.330738 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778d15a5-9bb0-4ec9-9071-3a06b1343d81 None admin] PATH_INFO: `/v3/projects` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:41.331677 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778d15a5-9bb0-4ec9-9071-3a06b1343d81 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:38:41.332255 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778d15a5-9bb0-4ec9-9071-3a06b1343d81 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:38:41.333891 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778d15a5-9bb0-4ec9-9071-3a06b1343d81 None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:38:41.349577 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 305/599] 10.222.0.93 () {56 vars in 1148 bytes} [Tue Jul 26 14:38:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:38:41.351996 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778d15a5-9bb0-4ec9-9071-3a06b1343d81 None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:41.396263 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd08cd2-d2dc-4767-8e6a-27572c6ac4d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:41.397394 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd08cd2-d2dc-4767-8e6a-27572c6ac4d1 None admin] REQUEST_METHOD: `PUT` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:41.397907 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd08cd2-d2dc-4767-8e6a-27572c6ac4d1 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:41.398369 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd08cd2-d2dc-4767-8e6a-27572c6ac4d1 None admin] PATH_INFO: `/v3/projects/c422a2290a14424da20e2841cbc1741d/users/2e86fe36c9bf49a481c9f15ac7571b88/roles/2e45ca312cda4bef9263725ae1c6dab7` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:41.427864 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:38:41.428927 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd08cd2-d2dc-4767-8e6a-27572c6ac4d1 None admin] RBAC: Authorizing `identity:create_grant(project_id=c422a2290a14424da20e2841cbc1741d, user_id=2e86fe36c9bf49a481c9f15ac7571b88, role_id=2e45ca312cda4bef9263725ae1c6dab7)` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:38:41.431782 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd08cd2-d2dc-4767-8e6a-27572c6ac4d1 None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:38:41.480253 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778d15a5-9bb0-4ec9-9071-3a06b1343d81 None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:41.512847 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 295/600] 10.222.0.93 () {58 vars in 1439 bytes} [Tue Jul 26 14:38:41 2022] PUT /identity/v3/projects/c422a2290a14424da20e2841cbc1741d/users/2e86fe36c9bf49a481c9f15ac7571b88/roles/2e45ca312cda4bef9263725ae1c6dab7 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 14:38:41.514657 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd08cd2-d2dc-4767-8e6a-27572c6ac4d1 None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:41.537950 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27814402-d9eb-4038-a2cb-2046c83dcb07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:41.539318 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27814402-d9eb-4038-a2cb-2046c83dcb07 None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:41.539886 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27814402-d9eb-4038-a2cb-2046c83dcb07 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:41.540343 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27814402-d9eb-4038-a2cb-2046c83dcb07 None admin] PATH_INFO: `/v3/users` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:41.541491 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27814402-d9eb-4038-a2cb-2046c83dcb07 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=87056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:38:41.542031 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27814402-d9eb-4038-a2cb-2046c83dcb07 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:38:41.543971 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27814402-d9eb-4038-a2cb-2046c83dcb07 None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:38:41.548342 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:38:41.586927 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 306/601] 10.222.0.93 () {56 vars in 1139 bytes} [Tue Jul 26 14:38:41 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:38:41.589540 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7815974d-ace8-46ec-92d3-4d93416ded95 None None] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:41.590176 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7815974d-ace8-46ec-92d3-4d93416ded95 None None] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:41.590877 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7815974d-ace8-46ec-92d3-4d93416ded95 None None] PATH_INFO: `/` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:41.594057 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 307/602] 10.222.0.93 () {54 vars in 926 bytes} [Tue Jul 26 14:38:41 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:38:41.597605 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7815974d-ace8-46ec-92d3-4d93416ded95 None None] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:41.685133 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd08cd2-d2dc-4767-8e6a-27572c6ac4d1 None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:41.741197 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284e6a0c-8531-4d4f-aca5-a14613900ab6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:41.742446 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284e6a0c-8531-4d4f-aca5-a14613900ab6 None admin] REQUEST_METHOD: `PUT` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:41.742875 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284e6a0c-8531-4d4f-aca5-a14613900ab6 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:41.743328 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284e6a0c-8531-4d4f-aca5-a14613900ab6 None admin] PATH_INFO: `/v3/projects/c422a2290a14424da20e2841cbc1741d/users/6780136eb21e4c8da1950b126284639e/roles/2e45ca312cda4bef9263725ae1c6dab7` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:41.767629 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284e6a0c-8531-4d4f-aca5-a14613900ab6 None admin] RBAC: Authorizing `identity:create_grant(project_id=c422a2290a14424da20e2841cbc1741d, user_id=6780136eb21e4c8da1950b126284639e, role_id=2e45ca312cda4bef9263725ae1c6dab7)` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:38:41.769345 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284e6a0c-8531-4d4f-aca5-a14613900ab6 None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:38:41.845058 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7815974d-ace8-46ec-92d3-4d93416ded95 None None] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:41.880757 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:38:41.895497 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 296/603] 10.222.0.93 () {58 vars in 1439 bytes} [Tue Jul 26 14:38:41 2022] PUT /identity/v3/projects/c422a2290a14424da20e2841cbc1741d/users/6780136eb21e4c8da1950b126284639e/roles/2e45ca312cda4bef9263725ae1c6dab7 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 14:38:41.898830 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbfe880-abe7-4781-8ba9-2a8426ea1e50 None None] REQUEST_METHOD: `POST` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:41.899518 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbfe880-abe7-4781-8ba9-2a8426ea1e50 None None] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:41.900253 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbfe880-abe7-4781-8ba9-2a8426ea1e50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:41.917563 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065e5680-8554-49bf-883a-9c5d5b583153 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:41.918793 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065e5680-8554-49bf-883a-9c5d5b583153 None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:41.919303 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065e5680-8554-49bf-883a-9c5d5b583153 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:41.919799 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065e5680-8554-49bf-883a-9c5d5b583153 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:41.933089 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.auth.core [None req-dbbfe880-abe7-4781-8ba9-2a8426ea1e50 None None] MFA Rules not processed for user `e5ef88cc058f425b882bcb87a1e1e75c`. Rule list: `[]` (Enabled: `True`). {{(pid=87055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:38:41.935827 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.fernet_utils [None req-dbbfe880-abe7-4781-8ba9-2a8426ea1e50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:38:41.947788 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065e5680-8554-49bf-883a-9c5d5b583153 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:38:41.949712 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065e5680-8554-49bf-883a-9c5d5b583153 None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:38:41.973635 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application [None req-065e5680-8554-49bf-883a-9c5d5b583153 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:38:41.973635 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:38:41.973635 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:38:41.973635 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:38:41.973635 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:38:41.973635 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:38:41.973635 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:38:41.973635 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:38:41.973635 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:38:41.973635 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:38:41.973635 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:38:41.973635 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:38:41.973635 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 14:38:41.973635 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 14:38:41.973635 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 14:38:41.974707 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 14:38:41.974707 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:38:41.974707 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:38:41.974707 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:38:41.974707 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:38:41.974707 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:38:41.974707 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:38:41.974707 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:38:41.974707 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application with Lock( Jul 26 14:38:41.974707 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:38:41.974707 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:38:41.974707 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:38:41.974707 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:38:41.974707 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:38:41.974707 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:38:41.974707 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:38:41.974707 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:38:41.976819 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 14:38:41.976819 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 14:38:41.976819 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:38:41.976819 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Jul 26 14:38:41.979521 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 308/604] 10.222.0.93 () {56 vars in 1108 bytes} [Tue Jul 26 14:38:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 383 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:38:41.993566 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065e5680-8554-49bf-883a-9c5d5b583153 None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:42.096155 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:38:42.136994 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 297/605] 10.222.0.93 () {58 vars in 1023 bytes} [Tue Jul 26 14:38:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 14:38:42.156754 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065e5680-8554-49bf-883a-9c5d5b583153 None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:42.177880 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbfe880-abe7-4781-8ba9-2a8426ea1e50 None None] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:42.213744 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e78355-c8f2-4817-b675-aabaa478393b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:42.215541 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e78355-c8f2-4817-b675-aabaa478393b None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:42.215541 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e78355-c8f2-4817-b675-aabaa478393b None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:42.215541 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e78355-c8f2-4817-b675-aabaa478393b None admin] PATH_INFO: `/v3/domains` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:42.215818 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e78355-c8f2-4817-b675-aabaa478393b None admin] RBAC: Adding query filter params (name=Default) {{(pid=87056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:38:42.216142 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e78355-c8f2-4817-b675-aabaa478393b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:38:42.218511 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e78355-c8f2-4817-b675-aabaa478393b None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:38:42.239966 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 309/606] 10.222.0.93 () {56 vars in 1109 bytes} [Tue Jul 26 14:38:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:38:42.247964 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e78355-c8f2-4817-b675-aabaa478393b None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:42.291660 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:38:42.354706 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbfe880-abe7-4781-8ba9-2a8426ea1e50 None None] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:42.379466 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e78355-c8f2-4817-b675-aabaa478393b None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:42.395641 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2018e9e2-3e21-4068-911f-b69554621e38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:42.396310 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2018e9e2-3e21-4068-911f-b69554621e38 None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:42.396652 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2018e9e2-3e21-4068-911f-b69554621e38 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:42.398135 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2018e9e2-3e21-4068-911f-b69554621e38 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:42.410934 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2018e9e2-3e21-4068-911f-b69554621e38 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 14:38:42.416955 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application [None req-2018e9e2-3e21-4068-911f-b69554621e38 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 26 14:38:42.416955 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:38:42.416955 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:38:42.416955 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:38:42.416955 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:38:42.416955 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:38:42.416955 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:38:42.416955 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:38:42.416955 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:38:42.416955 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:38:42.416955 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:38:42.416955 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:38:42.416955 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 14:38:42.416955 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 14:38:42.416955 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 14:38:42.416955 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 14:38:42.417952 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 14:38:42.417952 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 14:38:42.417952 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 14:38:42.417952 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 14:38:42.417952 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:38:42.417952 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:38:42.417952 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:38:42.417952 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:38:42.417952 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:38:42.417952 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:38:42.417952 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:38:42.417952 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application with Lock( Jul 26 14:38:42.417952 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:38:42.417952 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:38:42.417952 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:38:42.417952 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:38:42.431572 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:38:42.431572 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:38:42.431572 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:38:42.431572 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:38:42.431572 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 14:38:42.431572 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 14:38:42.431572 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 14:38:42.431572 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 14:38:42.431572 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 14:38:42.431572 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 14:38:42.431572 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 26 14:38:42.431572 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Jul 26 14:38:42.431572 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 298/607] 10.222.0.93 () {56 vars in 1102 bytes} [Tue Jul 26 14:38:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 14:38:42.431572 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cf4287-7f63-44d0-9012-cba02db25a80 None None] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:42.432341 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cf4287-7f63-44d0-9012-cba02db25a80 None None] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:42.432341 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cf4287-7f63-44d0-9012-cba02db25a80 None None] PATH_INFO: `/` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:42.432341 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 299/608] 10.222.0.93 () {54 vars in 926 bytes} [Tue Jul 26 14:38:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:38:42.432341 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cf4287-7f63-44d0-9012-cba02db25a80 None None] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:42.438397 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a3a014-6eb3-4987-9098-b30ff54c8a52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:42.439770 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a3a014-6eb3-4987-9098-b30ff54c8a52 None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:42.440276 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a3a014-6eb3-4987-9098-b30ff54c8a52 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:42.440893 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a3a014-6eb3-4987-9098-b30ff54c8a52 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:42.450418 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a3a014-6eb3-4987-9098-b30ff54c8a52 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:38:42.452388 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a3a014-6eb3-4987-9098-b30ff54c8a52 None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:38:42.467373 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application [None req-e4a3a014-6eb3-4987-9098-b30ff54c8a52 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 14:38:42.467373 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:38:42.467373 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:38:42.467373 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:38:42.467373 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:38:42.467373 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:38:42.467373 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:38:42.467373 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:38:42.467373 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:38:42.467373 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:38:42.467373 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:38:42.467373 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:38:42.467373 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 14:38:42.467373 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 14:38:42.467373 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 14:38:42.468540 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 14:38:42.468540 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:38:42.468540 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:38:42.468540 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:38:42.468540 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:38:42.468540 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:38:42.468540 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:38:42.468540 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:38:42.468540 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application with Lock( Jul 26 14:38:42.468540 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:38:42.468540 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:38:42.468540 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:38:42.468540 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:38:42.468540 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:38:42.468540 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:38:42.468540 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:38:42.468540 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:38:42.469843 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 14:38:42.469843 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 14:38:42.469843 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 14:38:42.469843 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 14:38:42.469843 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 14:38:42.469843 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 14:38:42.469843 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 14:38:42.469843 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Jul 26 14:38:42.476973 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 310/609] 10.222.0.93 () {56 vars in 1111 bytes} [Tue Jul 26 14:38:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:38:42.479659 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d53fb3-52e0-4e1f-b5f8-3b7cf5d9078b None None] REQUEST_METHOD: `POST` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:42.480542 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d53fb3-52e0-4e1f-b5f8-3b7cf5d9078b None None] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:42.481055 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d53fb3-52e0-4e1f-b5f8-3b7cf5d9078b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:42.496553 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:38:42.504532 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.auth.core [None req-e1d53fb3-52e0-4e1f-b5f8-3b7cf5d9078b None None] MFA Rules not processed for user `e5ef88cc058f425b882bcb87a1e1e75c`. Rule list: `[]` (Enabled: `True`). {{(pid=87056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:38:42.506676 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.fernet_utils [None req-e1d53fb3-52e0-4e1f-b5f8-3b7cf5d9078b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:38:42.561084 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cf4287-7f63-44d0-9012-cba02db25a80 None None] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:42.597712 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 311/610] 10.222.0.93 () {58 vars in 1023 bytes} [Tue Jul 26 14:38:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 14:38:42.599394 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d53fb3-52e0-4e1f-b5f8-3b7cf5d9078b None None] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:42.601365 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7896b002-766d-4055-9749-85d35ee8e0ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:42.602092 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7896b002-766d-4055-9749-85d35ee8e0ee None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:42.607014 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7896b002-766d-4055-9749-85d35ee8e0ee None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:42.607014 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7896b002-766d-4055-9749-85d35ee8e0ee None admin] PATH_INFO: `/v3/roles` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:42.607014 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7896b002-766d-4055-9749-85d35ee8e0ee None admin] RBAC: Adding query filter params (name=service) {{(pid=87055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:38:42.607014 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7896b002-766d-4055-9749-85d35ee8e0ee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:38:42.607014 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7896b002-766d-4055-9749-85d35ee8e0ee None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:38:42.617618 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 300/611] 10.222.0.93 () {56 vars in 1103 bytes} [Tue Jul 26 14:38:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:38:42.623033 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7896b002-766d-4055-9749-85d35ee8e0ee None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:42.651190 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:38:42.747734 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d53fb3-52e0-4e1f-b5f8-3b7cf5d9078b None None] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:42.752453 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7896b002-766d-4055-9749-85d35ee8e0ee None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:42.769279 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:38:42.795544 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa5103a-2453-4212-80f9-6c53832dbf9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:42.796281 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa5103a-2453-4212-80f9-6c53832dbf9e None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:42.796393 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74a4867-b999-4410-a7d6-d2ccd29e5c3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:42.796605 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa5103a-2453-4212-80f9-6c53832dbf9e None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:42.796847 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa5103a-2453-4212-80f9-6c53832dbf9e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:42.797907 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74a4867-b999-4410-a7d6-d2ccd29e5c3d None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:42.798489 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74a4867-b999-4410-a7d6-d2ccd29e5c3d None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:42.798976 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74a4867-b999-4410-a7d6-d2ccd29e5c3d None admin] PATH_INFO: `/v3/projects` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:42.800010 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74a4867-b999-4410-a7d6-d2ccd29e5c3d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:38:42.800550 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74a4867-b999-4410-a7d6-d2ccd29e5c3d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:38:42.802403 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74a4867-b999-4410-a7d6-d2ccd29e5c3d None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:38:42.810698 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa5103a-2453-4212-80f9-6c53832dbf9e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:38:42.812477 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa5103a-2453-4212-80f9-6c53832dbf9e None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:38:42.825419 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 312/612] 10.222.0.93 () {56 vars in 1148 bytes} [Tue Jul 26 14:38:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:38:42.826783 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74a4867-b999-4410-a7d6-d2ccd29e5c3d None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:42.831741 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application [None req-aaa5103a-2453-4212-80f9-6c53832dbf9e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:38:42.831741 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:38:42.831741 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:38:42.831741 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:38:42.831741 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:38:42.831741 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:38:42.831741 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:38:42.831741 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:38:42.831741 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:38:42.831741 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:38:42.831741 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:38:42.831741 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:38:42.831741 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 14:38:42.831741 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 14:38:42.831741 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 14:38:42.832875 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 14:38:42.832875 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:38:42.832875 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:38:42.832875 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:38:42.832875 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:38:42.832875 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:38:42.832875 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:38:42.832875 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:38:42.832875 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application with Lock( Jul 26 14:38:42.832875 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:38:42.832875 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:38:42.832875 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:38:42.832875 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:38:42.832875 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:38:42.832875 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:38:42.832875 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:38:42.832875 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:38:42.834017 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 14:38:42.834017 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 14:38:42.834017 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:38:42.834017 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Jul 26 14:38:42.836210 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 301/613] 10.222.0.93 () {56 vars in 1108 bytes} [Tue Jul 26 14:38:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:38:42.842008 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa5103a-2453-4212-80f9-6c53832dbf9e None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:42.962940 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa5103a-2453-4212-80f9-6c53832dbf9e None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:43.005608 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96950935-429c-4e46-b6d6-d5b873bbddd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:43.006867 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96950935-429c-4e46-b6d6-d5b873bbddd8 None admin] REQUEST_METHOD: `PUT` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:43.007268 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96950935-429c-4e46-b6d6-d5b873bbddd8 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:43.007656 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96950935-429c-4e46-b6d6-d5b873bbddd8 None admin] PATH_INFO: `/v3/projects/c422a2290a14424da20e2841cbc1741d/users/541dcf2b85a145e99c7d0663a0ac0918/roles/2e45ca312cda4bef9263725ae1c6dab7` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:43.026464 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96950935-429c-4e46-b6d6-d5b873bbddd8 None admin] RBAC: Authorizing `identity:create_grant(project_id=c422a2290a14424da20e2841cbc1741d, user_id=541dcf2b85a145e99c7d0663a0ac0918, role_id=2e45ca312cda4bef9263725ae1c6dab7)` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:38:43.028190 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96950935-429c-4e46-b6d6-d5b873bbddd8 None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:38:43.162661 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 302/614] 10.222.0.93 () {58 vars in 1439 bytes} [Tue Jul 26 14:38:42 2022] PUT /identity/v3/projects/c422a2290a14424da20e2841cbc1741d/users/541dcf2b85a145e99c7d0663a0ac0918/roles/2e45ca312cda4bef9263725ae1c6dab7 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 14:38:43.162661 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96950935-429c-4e46-b6d6-d5b873bbddd8 None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:43.165130 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:38:43.217453 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:38:43.229246 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74a4867-b999-4410-a7d6-d2ccd29e5c3d None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:43.302377 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b9146f-695e-446e-8c1c-e53e68e1e650 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:43.304633 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b9146f-695e-446e-8c1c-e53e68e1e650 None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:43.305502 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b9146f-695e-446e-8c1c-e53e68e1e650 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:43.306387 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b9146f-695e-446e-8c1c-e53e68e1e650 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:43.332978 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b9146f-695e-446e-8c1c-e53e68e1e650 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 14:38:43.344157 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application [None req-28b9146f-695e-446e-8c1c-e53e68e1e650 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 26 14:38:43.344157 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:38:43.344157 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:38:43.344157 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:38:43.344157 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:38:43.344157 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:38:43.344157 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:38:43.344157 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:38:43.344157 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:38:43.344157 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:38:43.344157 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:38:43.344157 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:38:43.344157 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 14:38:43.344157 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 14:38:43.344157 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 14:38:43.344157 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 14:38:43.346746 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 14:38:43.346746 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 14:38:43.346746 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 14:38:43.346746 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 14:38:43.346746 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:38:43.346746 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:38:43.346746 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:38:43.346746 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:38:43.346746 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:38:43.346746 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:38:43.346746 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:38:43.346746 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application with Lock( Jul 26 14:38:43.346746 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:38:43.346746 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:38:43.346746 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:38:43.346746 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:38:43.347591 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:38:43.347591 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:38:43.347591 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:38:43.347591 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:38:43.347591 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 14:38:43.347591 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 14:38:43.347591 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 14:38:43.347591 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 14:38:43.347591 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 14:38:43.347591 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 14:38:43.347591 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 26 14:38:43.347591 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Jul 26 14:38:43.353198 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 313/615] 10.222.0.93 () {56 vars in 1102 bytes} [Tue Jul 26 14:38:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 526 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:38:43.367995 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b9146f-695e-446e-8c1c-e53e68e1e650 None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:43.504210 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96950935-429c-4e46-b6d6-d5b873bbddd8 None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:43.586586 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0db2d9-d381-4719-b5ae-761e1b35111d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:43.587902 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0db2d9-d381-4719-b5ae-761e1b35111d None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:43.588331 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b9146f-695e-446e-8c1c-e53e68e1e650 None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:43.588589 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0db2d9-d381-4719-b5ae-761e1b35111d None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:43.589107 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0db2d9-d381-4719-b5ae-761e1b35111d None admin] PATH_INFO: `/v3/domains` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:43.590517 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0db2d9-d381-4719-b5ae-761e1b35111d None admin] RBAC: Adding query filter params (name=Default) {{(pid=87055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:38:43.591217 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0db2d9-d381-4719-b5ae-761e1b35111d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:38:43.593990 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0db2d9-d381-4719-b5ae-761e1b35111d None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:38:43.628343 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 303/616] 10.222.0.93 () {56 vars in 1109 bytes} [Tue Jul 26 14:38:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 469 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:38:43.638292 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0db2d9-d381-4719-b5ae-761e1b35111d None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:43.641493 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acc91c6-39ee-44d9-8b99-57d0fa91b58a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:43.642455 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acc91c6-39ee-44d9-8b99-57d0fa91b58a None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:43.642971 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acc91c6-39ee-44d9-8b99-57d0fa91b58a None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:43.643504 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acc91c6-39ee-44d9-8b99-57d0fa91b58a None admin] PATH_INFO: `/v3/roles` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:43.644473 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acc91c6-39ee-44d9-8b99-57d0fa91b58a None admin] RBAC: Adding query filter params (name=service) {{(pid=87056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:38:43.645025 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acc91c6-39ee-44d9-8b99-57d0fa91b58a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:38:43.647263 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acc91c6-39ee-44d9-8b99-57d0fa91b58a None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:38:43.681116 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 314/617] 10.222.0.93 () {56 vars in 1103 bytes} [Tue Jul 26 14:38:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:38:43.691454 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acc91c6-39ee-44d9-8b99-57d0fa91b58a None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:43.704518 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:38:43.873870 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:38:43.970408 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0db2d9-d381-4719-b5ae-761e1b35111d None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:43.984463 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acc91c6-39ee-44d9-8b99-57d0fa91b58a None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:44.056904 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcb9bdc-b736-4017-b79e-22dfffadd19e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:44.058056 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcb9bdc-b736-4017-b79e-22dfffadd19e None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:44.058607 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcb9bdc-b736-4017-b79e-22dfffadd19e None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:44.059111 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcb9bdc-b736-4017-b79e-22dfffadd19e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:44.066013 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6475b8de-5ee8-4a63-b00f-26db0d146293 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:44.066721 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6475b8de-5ee8-4a63-b00f-26db0d146293 None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:44.067007 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6475b8de-5ee8-4a63-b00f-26db0d146293 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:44.067276 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6475b8de-5ee8-4a63-b00f-26db0d146293 None admin] PATH_INFO: `/v3/users/swift` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:44.077344 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6475b8de-5ee8-4a63-b00f-26db0d146293 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:38:44.078871 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6475b8de-5ee8-4a63-b00f-26db0d146293 None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:38:44.081235 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcb9bdc-b736-4017-b79e-22dfffadd19e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:38:44.085258 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcb9bdc-b736-4017-b79e-22dfffadd19e None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:38:44.093484 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application [None req-6475b8de-5ee8-4a63-b00f-26db0d146293 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 26 14:38:44.093484 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:38:44.093484 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:38:44.093484 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:38:44.093484 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:38:44.093484 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:38:44.093484 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:38:44.093484 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:38:44.093484 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:38:44.093484 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:38:44.093484 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:38:44.093484 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:38:44.093484 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 14:38:44.093484 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 14:38:44.093484 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 14:38:44.093484 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 14:38:44.094556 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:38:44.094556 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:38:44.094556 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 14:38:44.094556 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 14:38:44.094556 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 14:38:44.094556 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 14:38:44.094556 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:38:44.094556 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:38:44.094556 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:38:44.094556 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:38:44.094556 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:38:44.094556 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application with Lock( Jul 26 14:38:44.094556 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:38:44.094556 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:38:44.094556 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:38:44.094556 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:38:44.094556 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:38:44.094556 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:38:44.095511 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:38:44.095511 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:38:44.095511 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 14:38:44.095511 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 14:38:44.095511 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 14:38:44.095511 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 14:38:44.095511 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 14:38:44.095511 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 14:38:44.095511 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 26 14:38:44.095511 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Jul 26 14:38:44.095511 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 304/618] 10.222.0.93 () {56 vars in 1096 bytes} [Tue Jul 26 14:38:43 2022] GET /identity/v3/users/swift => generated 83 bytes in 461 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 14:38:44.096708 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4d549f-6538-4095-b4a5-88fb82da1acb None None] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:44.096708 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4d549f-6538-4095-b4a5-88fb82da1acb None None] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:44.097020 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4d549f-6538-4095-b4a5-88fb82da1acb None None] PATH_INFO: `/` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:44.103044 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 305/619] 10.222.0.93 () {54 vars in 926 bytes} [Tue Jul 26 14:38:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:38:44.105201 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4d549f-6538-4095-b4a5-88fb82da1acb None None] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:44.115879 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application [None req-4bcb9bdc-b736-4017-b79e-22dfffadd19e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:38:44.115879 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:38:44.115879 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:38:44.115879 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:38:44.115879 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:38:44.115879 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:38:44.115879 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:38:44.115879 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:38:44.115879 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:38:44.115879 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:38:44.115879 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:38:44.115879 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:38:44.115879 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 14:38:44.115879 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 14:38:44.115879 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 14:38:44.118206 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 14:38:44.118206 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:38:44.118206 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:38:44.118206 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:38:44.118206 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:38:44.118206 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:38:44.118206 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:38:44.118206 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:38:44.118206 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application with Lock( Jul 26 14:38:44.118206 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:38:44.118206 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:38:44.118206 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:38:44.118206 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:38:44.118206 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:38:44.118206 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:38:44.118206 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:38:44.118206 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:38:44.120509 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 14:38:44.120509 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 14:38:44.120509 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:38:44.120509 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Jul 26 14:38:44.120509 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 315/620] 10.222.0.93 () {56 vars in 1108 bytes} [Tue Jul 26 14:38:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 428 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:38:44.121210 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c864e48-2439-4b3f-9516-f2997eb09ea7 None None] REQUEST_METHOD: `POST` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:44.126358 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c864e48-2439-4b3f-9516-f2997eb09ea7 None None] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:44.126358 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c864e48-2439-4b3f-9516-f2997eb09ea7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:44.155425 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.auth.core [None req-6c864e48-2439-4b3f-9516-f2997eb09ea7 None None] MFA Rules not processed for user `e5ef88cc058f425b882bcb87a1e1e75c`. Rule list: `[]` (Enabled: `True`). {{(pid=87056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:38:44.158012 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.fernet_utils [None req-6c864e48-2439-4b3f-9516-f2997eb09ea7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:38:44.251798 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4d549f-6538-4095-b4a5-88fb82da1acb None None] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:44.265931 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:38:44.300606 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 316/621] 10.222.0.93 () {58 vars in 1023 bytes} [Tue Jul 26 14:38:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 14:38:44.302154 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c864e48-2439-4b3f-9516-f2997eb09ea7 None None] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:44.316648 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53ed168-79e6-4d2f-a424-416a72cdf318 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:44.317548 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53ed168-79e6-4d2f-a424-416a72cdf318 None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:44.320666 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53ed168-79e6-4d2f-a424-416a72cdf318 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:44.321292 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53ed168-79e6-4d2f-a424-416a72cdf318 None admin] PATH_INFO: `/v3/users` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:44.322433 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53ed168-79e6-4d2f-a424-416a72cdf318 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=87055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:38:44.322899 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53ed168-79e6-4d2f-a424-416a72cdf318 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:38:44.324561 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53ed168-79e6-4d2f-a424-416a72cdf318 None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:38:44.336257 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:38:44.353006 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 306/622] 10.222.0.93 () {56 vars in 1135 bytes} [Tue Jul 26 14:38:44 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:38:44.357972 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53ed168-79e6-4d2f-a424-416a72cdf318 None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:44.476839 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c864e48-2439-4b3f-9516-f2997eb09ea7 None None] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:44.517616 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e89b05-7ab7-41ca-a9b9-a83d69a91e33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:44.518281 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e89b05-7ab7-41ca-a9b9-a83d69a91e33 None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:44.518558 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e89b05-7ab7-41ca-a9b9-a83d69a91e33 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:44.518830 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e89b05-7ab7-41ca-a9b9-a83d69a91e33 None admin] PATH_INFO: `/v3/domains` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:44.519534 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e89b05-7ab7-41ca-a9b9-a83d69a91e33 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:38:44.519843 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e89b05-7ab7-41ca-a9b9-a83d69a91e33 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:38:44.521245 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e89b05-7ab7-41ca-a9b9-a83d69a91e33 None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:38:44.533519 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53ed168-79e6-4d2f-a424-416a72cdf318 None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:44.540789 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 317/623] 10.222.0.93 () {56 vars in 1109 bytes} [Tue Jul 26 14:38:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:38:44.540789 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e89b05-7ab7-41ca-a9b9-a83d69a91e33 None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:44.596326 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dff49a5-3de4-41cf-920c-1ecac301c689 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:44.597270 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dff49a5-3de4-41cf-920c-1ecac301c689 None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:44.597696 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dff49a5-3de4-41cf-920c-1ecac301c689 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:44.598109 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dff49a5-3de4-41cf-920c-1ecac301c689 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:44.610570 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:38:44.616975 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dff49a5-3de4-41cf-920c-1ecac301c689 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:38:44.618821 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dff49a5-3de4-41cf-920c-1ecac301c689 None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:38:44.644849 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application [None req-8dff49a5-3de4-41cf-920c-1ecac301c689 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:38:44.644849 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:38:44.644849 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:38:44.644849 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:38:44.644849 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:38:44.644849 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:38:44.644849 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:38:44.644849 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:38:44.644849 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:38:44.644849 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:38:44.644849 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:38:44.644849 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:38:44.644849 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 14:38:44.644849 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 14:38:44.644849 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 14:38:44.647468 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 14:38:44.647468 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:38:44.647468 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:38:44.647468 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:38:44.647468 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:38:44.647468 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:38:44.647468 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:38:44.647468 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:38:44.647468 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application with Lock( Jul 26 14:38:44.647468 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:38:44.647468 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:38:44.647468 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:38:44.647468 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:38:44.647468 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:38:44.647468 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:38:44.647468 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:38:44.647468 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:38:44.649295 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 14:38:44.649295 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 14:38:44.649295 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:38:44.649295 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Jul 26 14:38:44.654323 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 307/624] 10.222.0.93 () {56 vars in 1108 bytes} [Tue Jul 26 14:38:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:38:44.656809 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ca8f82-fde7-4d45-82b9-b78fa9fd39aa None None] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:44.657252 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ca8f82-fde7-4d45-82b9-b78fa9fd39aa None None] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:44.657720 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ca8f82-fde7-4d45-82b9-b78fa9fd39aa None None] PATH_INFO: `/` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:44.659884 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 308/625] 10.222.0.93 () {54 vars in 926 bytes} [Tue Jul 26 14:38:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:38:44.667475 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ca8f82-fde7-4d45-82b9-b78fa9fd39aa None None] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:44.705158 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e89b05-7ab7-41ca-a9b9-a83d69a91e33 None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:44.753643 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9bf9e3-5437-4f75-9e96-a85a87dbeae4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:44.754854 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9bf9e3-5437-4f75-9e96-a85a87dbeae4 None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:44.755388 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9bf9e3-5437-4f75-9e96-a85a87dbeae4 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:44.756446 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9bf9e3-5437-4f75-9e96-a85a87dbeae4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:44.759824 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:38:44.773501 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9bf9e3-5437-4f75-9e96-a85a87dbeae4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 14:38:44.780419 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application [None req-2c9bf9e3-5437-4f75-9e96-a85a87dbeae4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 26 14:38:44.780419 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:38:44.780419 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:38:44.780419 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:38:44.780419 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:38:44.780419 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:38:44.780419 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:38:44.780419 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:38:44.780419 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:38:44.780419 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:38:44.780419 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:38:44.780419 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:38:44.780419 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 14:38:44.780419 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 14:38:44.780419 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 14:38:44.780419 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 14:38:44.781434 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 14:38:44.781434 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 14:38:44.781434 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 14:38:44.781434 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 14:38:44.781434 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:38:44.781434 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:38:44.781434 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:38:44.781434 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:38:44.781434 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:38:44.781434 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:38:44.781434 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:38:44.781434 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application with Lock( Jul 26 14:38:44.781434 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:38:44.781434 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:38:44.781434 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:38:44.781434 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:38:44.782579 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:38:44.782579 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:38:44.782579 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:38:44.782579 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:38:44.782579 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 14:38:44.782579 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 14:38:44.782579 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 14:38:44.782579 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 14:38:44.782579 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 14:38:44.782579 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 14:38:44.782579 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 26 14:38:44.782579 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Jul 26 14:38:44.784176 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 318/626] 10.222.0.93 () {56 vars in 1102 bytes} [Tue Jul 26 14:38:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:38:44.785714 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9bf9e3-5437-4f75-9e96-a85a87dbeae4 None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:44.847726 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ca8f82-fde7-4d45-82b9-b78fa9fd39aa None None] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:44.892226 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efd7228-153c-45fe-8016-623a3c823bf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:44.893598 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efd7228-153c-45fe-8016-623a3c823bf2 None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:44.894043 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efd7228-153c-45fe-8016-623a3c823bf2 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:44.894882 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efd7228-153c-45fe-8016-623a3c823bf2 None admin] PATH_INFO: `/v3/users/glance` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:44.906078 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efd7228-153c-45fe-8016-623a3c823bf2 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:38:44.908426 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efd7228-153c-45fe-8016-623a3c823bf2 None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:38:44.923342 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9bf9e3-5437-4f75-9e96-a85a87dbeae4 None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:44.923552 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application [None req-1efd7228-153c-45fe-8016-623a3c823bf2 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 26 14:38:44.923552 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:38:44.923552 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:38:44.923552 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:38:44.923552 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:38:44.923552 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:38:44.923552 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:38:44.923552 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:38:44.923552 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:38:44.923552 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:38:44.923552 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:38:44.923552 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:38:44.923552 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 14:38:44.923552 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 14:38:44.923552 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 14:38:44.923552 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 14:38:44.924447 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:38:44.924447 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:38:44.924447 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 14:38:44.924447 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 14:38:44.924447 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 14:38:44.924447 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 14:38:44.924447 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:38:44.924447 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:38:44.924447 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:38:44.924447 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:38:44.924447 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:38:44.924447 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application with Lock( Jul 26 14:38:44.924447 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:38:44.924447 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:38:44.924447 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:38:44.924447 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:38:44.924447 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:38:44.924447 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:38:44.925387 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:38:44.925387 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:38:44.925387 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 14:38:44.925387 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 14:38:44.925387 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 14:38:44.925387 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 14:38:44.925387 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 14:38:44.925387 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 14:38:44.925387 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 26 14:38:44.925387 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Jul 26 14:38:44.929501 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:38:44.930175 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 309/627] 10.222.0.93 () {56 vars in 1099 bytes} [Tue Jul 26 14:38:44 2022] GET /identity/v3/users/glance => generated 84 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:38:44.931665 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2bb0eb-59fd-4c2f-bdf7-ea8870bc0382 None None] REQUEST_METHOD: `POST` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:44.931958 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2bb0eb-59fd-4c2f-bdf7-ea8870bc0382 None None] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:44.932404 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2bb0eb-59fd-4c2f-bdf7-ea8870bc0382 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:44.952627 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.auth.core [None req-3c2bb0eb-59fd-4c2f-bdf7-ea8870bc0382 None None] MFA Rules not processed for user `e5ef88cc058f425b882bcb87a1e1e75c`. Rule list: `[]` (Enabled: `True`). {{(pid=87055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:38:44.954143 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.fernet_utils [None req-3c2bb0eb-59fd-4c2f-bdf7-ea8870bc0382 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:38:44.988494 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a90c22-b821-460d-ab99-d3a5229344b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:44.989270 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a90c22-b821-460d-ab99-d3a5229344b6 None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:44.989560 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a90c22-b821-460d-ab99-d3a5229344b6 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:44.989842 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a90c22-b821-460d-ab99-d3a5229344b6 None admin] PATH_INFO: `/v3/domains` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:44.991119 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a90c22-b821-460d-ab99-d3a5229344b6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:38:44.991433 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a90c22-b821-460d-ab99-d3a5229344b6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:38:44.992874 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a90c22-b821-460d-ab99-d3a5229344b6 None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:38:45.010680 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 319/628] 10.222.0.93 () {56 vars in 1109 bytes} [Tue Jul 26 14:38:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:38:45.011959 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a90c22-b821-460d-ab99-d3a5229344b6 None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:45.059445 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 310/629] 10.222.0.93 () {58 vars in 1023 bytes} [Tue Jul 26 14:38:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 14:38:45.060689 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2bb0eb-59fd-4c2f-bdf7-ea8870bc0382 None None] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:45.112739 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:38:45.178663 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a90c22-b821-460d-ab99-d3a5229344b6 None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:45.202695 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2bb0eb-59fd-4c2f-bdf7-ea8870bc0382 None None] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:45.220684 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3ac06d-e450-41d5-acd5-3b64016bd973 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:45.221046 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3ac06d-e450-41d5-acd5-3b64016bd973 None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:45.221333 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3ac06d-e450-41d5-acd5-3b64016bd973 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:45.221611 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3ac06d-e450-41d5-acd5-3b64016bd973 None admin] PATH_INFO: `/v3/roles` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:45.222430 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3ac06d-e450-41d5-acd5-3b64016bd973 None admin] RBAC: Adding query filter params (name=service) {{(pid=87056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:38:45.222741 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3ac06d-e450-41d5-acd5-3b64016bd973 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:38:45.224308 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3ac06d-e450-41d5-acd5-3b64016bd973 None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:38:45.234224 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 320/630] 10.222.0.93 () {56 vars in 1103 bytes} [Tue Jul 26 14:38:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:38:45.235123 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3ac06d-e450-41d5-acd5-3b64016bd973 None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:45.264475 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9adcb7-13e2-4fe9-bebb-b3e5b67fe45b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:45.265009 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9adcb7-13e2-4fe9-bebb-b3e5b67fe45b None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:45.265541 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9adcb7-13e2-4fe9-bebb-b3e5b67fe45b None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:45.265541 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9adcb7-13e2-4fe9-bebb-b3e5b67fe45b None admin] PATH_INFO: `/v3/users` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:45.266411 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9adcb7-13e2-4fe9-bebb-b3e5b67fe45b None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=87055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:38:45.266732 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9adcb7-13e2-4fe9-bebb-b3e5b67fe45b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:38:45.268193 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9adcb7-13e2-4fe9-bebb-b3e5b67fe45b None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:38:45.283063 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:38:45.290961 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 311/631] 10.222.0.93 () {56 vars in 1137 bytes} [Tue Jul 26 14:38:45 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:38:45.291802 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9adcb7-13e2-4fe9-bebb-b3e5b67fe45b None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:45.402404 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3ac06d-e450-41d5-acd5-3b64016bd973 None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:45.413089 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:38:45.422879 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9adcb7-13e2-4fe9-bebb-b3e5b67fe45b None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:45.442093 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29ca12f-c9cb-4135-9433-2f200da442e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:45.442924 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29ca12f-c9cb-4135-9433-2f200da442e4 None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:45.443862 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29ca12f-c9cb-4135-9433-2f200da442e4 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:45.444214 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29ca12f-c9cb-4135-9433-2f200da442e4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:45.452211 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29ca12f-c9cb-4135-9433-2f200da442e4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:38:45.453792 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29ca12f-c9cb-4135-9433-2f200da442e4 None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:38:45.466291 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f802594-e8c6-4acc-b7bf-ee19a012aad0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:45.467168 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application [None req-e29ca12f-c9cb-4135-9433-2f200da442e4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 14:38:45.467168 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:38:45.467168 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:38:45.467168 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:38:45.467168 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:38:45.467168 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:38:45.467168 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:38:45.467168 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:38:45.467168 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:38:45.467168 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:38:45.467168 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:38:45.467168 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:38:45.467168 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 14:38:45.467168 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 14:38:45.467168 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 14:38:45.469339 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 14:38:45.469339 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:38:45.469339 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:38:45.469339 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:38:45.469339 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:38:45.469339 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:38:45.469339 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:38:45.469339 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:38:45.469339 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application with Lock( Jul 26 14:38:45.469339 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:38:45.469339 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:38:45.469339 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:38:45.469339 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:38:45.469339 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:38:45.469339 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:38:45.469339 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:38:45.469339 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:38:45.471212 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 14:38:45.471212 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 14:38:45.471212 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 14:38:45.471212 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 14:38:45.471212 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 14:38:45.471212 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 14:38:45.471212 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 14:38:45.471212 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Jul 26 14:38:45.472171 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f802594-e8c6-4acc-b7bf-ee19a012aad0 None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:45.472171 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f802594-e8c6-4acc-b7bf-ee19a012aad0 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:45.472461 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 321/632] 10.222.0.93 () {56 vars in 1111 bytes} [Tue Jul 26 14:38:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:38:45.472461 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29ca12f-c9cb-4135-9433-2f200da442e4 None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:45.473539 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f802594-e8c6-4acc-b7bf-ee19a012aad0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:45.491463 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f802594-e8c6-4acc-b7bf-ee19a012aad0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 14:38:45.497663 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application [None req-8f802594-e8c6-4acc-b7bf-ee19a012aad0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 26 14:38:45.497663 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:38:45.497663 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:38:45.497663 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:38:45.497663 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:38:45.497663 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:38:45.497663 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:38:45.497663 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:38:45.497663 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:38:45.497663 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:38:45.497663 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:38:45.497663 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:38:45.497663 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 14:38:45.497663 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 14:38:45.497663 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 14:38:45.497663 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 14:38:45.499847 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 14:38:45.499847 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 14:38:45.499847 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 14:38:45.499847 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 14:38:45.499847 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:38:45.499847 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:38:45.499847 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:38:45.499847 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:38:45.499847 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:38:45.499847 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:38:45.499847 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:38:45.499847 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application with Lock( Jul 26 14:38:45.499847 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:38:45.499847 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:38:45.499847 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:38:45.499847 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:38:45.501489 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:38:45.501489 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:38:45.501489 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:38:45.501489 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:38:45.501489 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 14:38:45.501489 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 14:38:45.501489 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 14:38:45.501489 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 14:38:45.501489 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 14:38:45.501489 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 14:38:45.501489 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 26 14:38:45.501489 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Jul 26 14:38:45.501489 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 312/633] 10.222.0.93 () {56 vars in 1102 bytes} [Tue Jul 26 14:38:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:38:45.501489 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f802594-e8c6-4acc-b7bf-ee19a012aad0 None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:45.610448 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:38:45.635019 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29ca12f-c9cb-4135-9433-2f200da442e4 None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:45.688962 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a484524-0d08-48a4-bdb1-255fc2b460ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:45.688962 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a484524-0d08-48a4-bdb1-255fc2b460ac None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:45.688962 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a484524-0d08-48a4-bdb1-255fc2b460ac None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:45.688962 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a484524-0d08-48a4-bdb1-255fc2b460ac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:45.704284 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a484524-0d08-48a4-bdb1-255fc2b460ac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:38:45.705954 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a484524-0d08-48a4-bdb1-255fc2b460ac None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:38:45.724156 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application [None req-7a484524-0d08-48a4-bdb1-255fc2b460ac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:38:45.724156 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:38:45.724156 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:38:45.724156 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:38:45.724156 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:38:45.724156 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:38:45.724156 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:38:45.724156 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:38:45.724156 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:38:45.724156 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:38:45.724156 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:38:45.724156 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:38:45.724156 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 14:38:45.724156 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 14:38:45.724156 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 14:38:45.726196 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 14:38:45.726196 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:38:45.726196 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:38:45.726196 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:38:45.726196 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:38:45.726196 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:38:45.726196 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:38:45.726196 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:38:45.726196 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application with Lock( Jul 26 14:38:45.726196 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:38:45.726196 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:38:45.726196 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:38:45.726196 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:38:45.726196 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:38:45.726196 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:38:45.726196 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:38:45.726196 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:38:45.727856 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 14:38:45.727856 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 14:38:45.727856 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:38:45.727856 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Jul 26 14:38:45.730196 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 322/634] 10.222.0.93 () {56 vars in 1108 bytes} [Tue Jul 26 14:38:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:38:45.731038 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a484524-0d08-48a4-bdb1-255fc2b460ac None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:45.791338 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f802594-e8c6-4acc-b7bf-ee19a012aad0 None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:45.830669 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4aa7c8-fff2-4bac-9e15-20fb0020459d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:45.831433 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4aa7c8-fff2-4bac-9e15-20fb0020459d None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:45.831825 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4aa7c8-fff2-4bac-9e15-20fb0020459d None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:45.832197 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4aa7c8-fff2-4bac-9e15-20fb0020459d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:45.852833 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a484524-0d08-48a4-bdb1-255fc2b460ac None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:45.860574 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:38:45.893954 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525f69cd-15bc-4639-800a-da8bea8a3360 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:45.897154 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525f69cd-15bc-4639-800a-da8bea8a3360 None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:45.897154 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525f69cd-15bc-4639-800a-da8bea8a3360 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:45.897154 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525f69cd-15bc-4639-800a-da8bea8a3360 None admin] PATH_INFO: `/v3/projects` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:45.897154 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525f69cd-15bc-4639-800a-da8bea8a3360 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:38:45.897154 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525f69cd-15bc-4639-800a-da8bea8a3360 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:38:45.899663 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525f69cd-15bc-4639-800a-da8bea8a3360 None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:38:45.908001 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:38:45.914090 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 323/635] 10.222.0.93 () {56 vars in 1148 bytes} [Tue Jul 26 14:38:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:38:45.915040 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525f69cd-15bc-4639-800a-da8bea8a3360 None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:45.915675 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4aa7c8-fff2-4bac-9e15-20fb0020459d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:38:45.917236 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4aa7c8-fff2-4bac-9e15-20fb0020459d None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:38:46.041776 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525f69cd-15bc-4639-800a-da8bea8a3360 None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:46.050661 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 313/636] 10.222.0.93 () {58 vars in 1282 bytes} [Tue Jul 26 14:38:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 550 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 14:38:46.058811 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4aa7c8-fff2-4bac-9e15-20fb0020459d None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:46.083755 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f77de8-ffbc-47b1-88f5-0e8cdbb1d405 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:46.084902 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f77de8-ffbc-47b1-88f5-0e8cdbb1d405 None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:46.085185 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f77de8-ffbc-47b1-88f5-0e8cdbb1d405 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:46.085462 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f77de8-ffbc-47b1-88f5-0e8cdbb1d405 None admin] PATH_INFO: `/v3/roles` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:46.086199 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f77de8-ffbc-47b1-88f5-0e8cdbb1d405 None admin] RBAC: Adding query filter params (name=service) {{(pid=87056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:38:46.086536 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f77de8-ffbc-47b1-88f5-0e8cdbb1d405 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:38:46.087950 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f77de8-ffbc-47b1-88f5-0e8cdbb1d405 None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:38:46.097273 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 324/637] 10.222.0.93 () {56 vars in 1103 bytes} [Tue Jul 26 14:38:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:38:46.098627 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694ed0d2-f7a3-4937-afb0-f381851b8b38 None None] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:46.098899 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694ed0d2-f7a3-4937-afb0-f381851b8b38 None None] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:46.099353 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694ed0d2-f7a3-4937-afb0-f381851b8b38 None None] PATH_INFO: `/` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:46.101793 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 325/638] 10.222.0.93 () {54 vars in 926 bytes} [Tue Jul 26 14:38:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:38:46.101986 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694ed0d2-f7a3-4937-afb0-f381851b8b38 None None] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:46.128661 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:38:46.177546 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:38:46.179988 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4aa7c8-fff2-4bac-9e15-20fb0020459d None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:46.221850 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2e4870-536d-4576-af6b-d24d5f14d7e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:46.222542 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2e4870-536d-4576-af6b-d24d5f14d7e0 None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:46.222825 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2e4870-536d-4576-af6b-d24d5f14d7e0 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:46.223107 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2e4870-536d-4576-af6b-d24d5f14d7e0 None admin] PATH_INFO: `/v3/domains` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:46.223835 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2e4870-536d-4576-af6b-d24d5f14d7e0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:38:46.224141 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2e4870-536d-4576-af6b-d24d5f14d7e0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:38:46.225595 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2e4870-536d-4576-af6b-d24d5f14d7e0 None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:38:46.230686 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694ed0d2-f7a3-4937-afb0-f381851b8b38 None None] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:46.244825 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 314/639] 10.222.0.93 () {56 vars in 1109 bytes} [Tue Jul 26 14:38:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:38:46.244825 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2e4870-536d-4576-af6b-d24d5f14d7e0 None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:46.271612 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94ba144-72a9-45d0-8493-5aa8890d7ff0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:46.272823 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94ba144-72a9-45d0-8493-5aa8890d7ff0 None admin] REQUEST_METHOD: `PUT` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:46.273097 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94ba144-72a9-45d0-8493-5aa8890d7ff0 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:46.273367 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94ba144-72a9-45d0-8493-5aa8890d7ff0 None admin] PATH_INFO: `/v3/projects/c422a2290a14424da20e2841cbc1741d/users/b914b2ba87e74def85f9694e1141e00b/roles/2e45ca312cda4bef9263725ae1c6dab7` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:46.296726 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94ba144-72a9-45d0-8493-5aa8890d7ff0 None admin] RBAC: Authorizing `identity:create_grant(project_id=c422a2290a14424da20e2841cbc1741d, user_id=b914b2ba87e74def85f9694e1141e00b, role_id=2e45ca312cda4bef9263725ae1c6dab7)` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:38:46.299280 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94ba144-72a9-45d0-8493-5aa8890d7ff0 None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:38:46.368819 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2e4870-536d-4576-af6b-d24d5f14d7e0 None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:46.389225 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:38:46.389468 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 326/640] 10.222.0.93 () {58 vars in 1439 bytes} [Tue Jul 26 14:38:46 2022] PUT /identity/v3/projects/c422a2290a14424da20e2841cbc1741d/users/b914b2ba87e74def85f9694e1141e00b/roles/2e45ca312cda4bef9263725ae1c6dab7 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 14:38:46.389468 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94ba144-72a9-45d0-8493-5aa8890d7ff0 None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:46.424766 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca2ae17-efcc-4541-a1f6-253a06542452 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:46.425449 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca2ae17-efcc-4541-a1f6-253a06542452 None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:46.429622 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca2ae17-efcc-4541-a1f6-253a06542452 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:46.429622 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca2ae17-efcc-4541-a1f6-253a06542452 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:46.441677 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca2ae17-efcc-4541-a1f6-253a06542452 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:38:46.443359 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca2ae17-efcc-4541-a1f6-253a06542452 None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:38:46.464240 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application [None req-5ca2ae17-efcc-4541-a1f6-253a06542452 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:38:46.464240 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:38:46.464240 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:38:46.464240 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:38:46.464240 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:38:46.464240 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:38:46.464240 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:38:46.464240 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:38:46.464240 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:38:46.464240 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:38:46.464240 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:38:46.464240 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:38:46.464240 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 14:38:46.464240 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 14:38:46.464240 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 14:38:46.466011 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 14:38:46.466011 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:38:46.466011 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:38:46.466011 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:38:46.466011 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:38:46.466011 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:38:46.466011 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:38:46.466011 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:38:46.466011 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application with Lock( Jul 26 14:38:46.466011 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:38:46.466011 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:38:46.466011 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:38:46.466011 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:38:46.466011 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:38:46.466011 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:38:46.466011 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:38:46.466011 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:38:46.467652 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 14:38:46.467652 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 14:38:46.467652 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:38:46.467652 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Jul 26 14:38:46.467652 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 315/641] 10.222.0.93 () {56 vars in 1108 bytes} [Tue Jul 26 14:38:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:38:46.467652 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff690f8-9d8d-4522-b033-40afb1e7a6ac None None] REQUEST_METHOD: `POST` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:46.467652 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff690f8-9d8d-4522-b033-40afb1e7a6ac None None] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:46.468045 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff690f8-9d8d-4522-b033-40afb1e7a6ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:46.488784 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.auth.core [None req-3ff690f8-9d8d-4522-b033-40afb1e7a6ac None None] MFA Rules not processed for user `e5ef88cc058f425b882bcb87a1e1e75c`. Rule list: `[]` (Enabled: `True`). {{(pid=87055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:38:46.490079 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.fernet_utils [None req-3ff690f8-9d8d-4522-b033-40afb1e7a6ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:38:46.541511 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94ba144-72a9-45d0-8493-5aa8890d7ff0 None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:46.558122 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:38:46.589713 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 316/642] 10.222.0.93 () {58 vars in 1023 bytes} [Tue Jul 26 14:38:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 14:38:46.591257 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff690f8-9d8d-4522-b033-40afb1e7a6ac None None] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:46.594197 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b1f8d8-3f96-4210-ba10-4f9209eae78d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:46.594925 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b1f8d8-3f96-4210-ba10-4f9209eae78d None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:46.595212 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b1f8d8-3f96-4210-ba10-4f9209eae78d None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:46.595593 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b1f8d8-3f96-4210-ba10-4f9209eae78d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:46.608972 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b1f8d8-3f96-4210-ba10-4f9209eae78d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:38:46.611246 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b1f8d8-3f96-4210-ba10-4f9209eae78d None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:38:46.634004 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application [None req-18b1f8d8-3f96-4210-ba10-4f9209eae78d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:38:46.634004 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:38:46.634004 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:38:46.634004 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:38:46.634004 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:38:46.634004 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:38:46.634004 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:38:46.634004 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:38:46.634004 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:38:46.634004 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:38:46.634004 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:38:46.634004 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:38:46.634004 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 14:38:46.634004 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 14:38:46.634004 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 14:38:46.635766 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 14:38:46.635766 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:38:46.635766 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:38:46.635766 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:38:46.635766 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:38:46.635766 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:38:46.635766 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:38:46.635766 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:38:46.635766 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application with Lock( Jul 26 14:38:46.635766 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:38:46.635766 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:38:46.635766 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:38:46.635766 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:38:46.635766 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:38:46.635766 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:38:46.635766 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:38:46.635766 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:38:46.637481 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 14:38:46.637481 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 14:38:46.637481 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:38:46.637481 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Jul 26 14:38:46.637481 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 327/643] 10.222.0.93 () {56 vars in 1108 bytes} [Tue Jul 26 14:38:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:38:46.637481 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b1f8d8-3f96-4210-ba10-4f9209eae78d None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:46.762360 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:38:46.771993 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff690f8-9d8d-4522-b033-40afb1e7a6ac None None] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:46.820729 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cc138f-abe4-45c6-9d5e-775a1a598ca5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:46.821415 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cc138f-abe4-45c6-9d5e-775a1a598ca5 None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:46.821665 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cc138f-abe4-45c6-9d5e-775a1a598ca5 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:46.821939 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cc138f-abe4-45c6-9d5e-775a1a598ca5 None admin] PATH_INFO: `/v3/users/nova` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:46.828476 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b1f8d8-3f96-4210-ba10-4f9209eae78d None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:46.835297 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cc138f-abe4-45c6-9d5e-775a1a598ca5 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:38:46.836776 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cc138f-abe4-45c6-9d5e-775a1a598ca5 None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:38:46.854114 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application [None req-e6cc138f-abe4-45c6-9d5e-775a1a598ca5 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 26 14:38:46.854114 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:38:46.854114 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:38:46.854114 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:38:46.854114 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:38:46.854114 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:38:46.854114 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:38:46.854114 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:38:46.854114 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:38:46.854114 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:38:46.854114 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:38:46.854114 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:38:46.854114 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 14:38:46.854114 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 14:38:46.854114 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 14:38:46.854114 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 14:38:46.855680 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:38:46.855680 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:38:46.855680 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 14:38:46.855680 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 14:38:46.855680 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 14:38:46.855680 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 14:38:46.855680 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:38:46.855680 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:38:46.855680 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:38:46.855680 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:38:46.855680 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:38:46.855680 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application with Lock( Jul 26 14:38:46.855680 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:38:46.855680 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:38:46.855680 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:38:46.855680 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:38:46.855680 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:38:46.855680 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:38:46.857541 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:38:46.857541 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:38:46.857541 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 14:38:46.857541 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 14:38:46.857541 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 14:38:46.857541 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 14:38:46.857541 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 14:38:46.857541 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 14:38:46.857541 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 26 14:38:46.857541 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Jul 26 14:38:46.857541 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 317/644] 10.222.0.93 () {56 vars in 1093 bytes} [Tue Jul 26 14:38:46 2022] GET /identity/v3/users/nova => generated 82 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:38:46.859786 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cc138f-abe4-45c6-9d5e-775a1a598ca5 None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:46.902326 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f2a4a6-d4ab-4e8a-a9b8-478c7153736b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:46.903402 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f2a4a6-d4ab-4e8a-a9b8-478c7153736b None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:46.903899 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f2a4a6-d4ab-4e8a-a9b8-478c7153736b None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:46.904373 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f2a4a6-d4ab-4e8a-a9b8-478c7153736b None admin] PATH_INFO: `/v3/domains` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:46.905661 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f2a4a6-d4ab-4e8a-a9b8-478c7153736b None admin] RBAC: Adding query filter params (name=Default) {{(pid=87056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:38:46.906352 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f2a4a6-d4ab-4e8a-a9b8-478c7153736b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:38:46.909498 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f2a4a6-d4ab-4e8a-a9b8-478c7153736b None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:38:46.933962 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 328/645] 10.222.0.93 () {56 vars in 1109 bytes} [Tue Jul 26 14:38:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:38:46.936821 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f2a4a6-d4ab-4e8a-a9b8-478c7153736b None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:46.970236 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:38:47.069518 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cc138f-abe4-45c6-9d5e-775a1a598ca5 None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:47.079044 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f2a4a6-d4ab-4e8a-a9b8-478c7153736b None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:47.127406 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13bb01b-bac9-4256-8428-0c3895c70458 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:47.128421 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13bb01b-bac9-4256-8428-0c3895c70458 None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:47.128874 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13bb01b-bac9-4256-8428-0c3895c70458 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:47.129329 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13bb01b-bac9-4256-8428-0c3895c70458 None admin] PATH_INFO: `/v3/domains` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:47.130571 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13bb01b-bac9-4256-8428-0c3895c70458 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:38:47.131093 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13bb01b-bac9-4256-8428-0c3895c70458 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:38:47.132706 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238b3677-5e7e-47aa-a120-86f1d9dcb280 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:47.133901 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13bb01b-bac9-4256-8428-0c3895c70458 None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:38:47.134033 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238b3677-5e7e-47aa-a120-86f1d9dcb280 None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:47.134468 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238b3677-5e7e-47aa-a120-86f1d9dcb280 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:47.134951 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238b3677-5e7e-47aa-a120-86f1d9dcb280 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:47.154488 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 329/646] 10.222.0.93 () {56 vars in 1109 bytes} [Tue Jul 26 14:38:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:38:47.156002 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13bb01b-bac9-4256-8428-0c3895c70458 None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:47.160910 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238b3677-5e7e-47aa-a120-86f1d9dcb280 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 14:38:47.167942 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application [None req-238b3677-5e7e-47aa-a120-86f1d9dcb280 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 26 14:38:47.167942 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:38:47.167942 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:38:47.167942 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:38:47.167942 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:38:47.167942 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:38:47.167942 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:38:47.167942 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:38:47.167942 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:38:47.167942 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:38:47.167942 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:38:47.167942 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:38:47.167942 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 14:38:47.167942 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 14:38:47.167942 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 14:38:47.167942 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 14:38:47.169771 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 14:38:47.169771 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 14:38:47.169771 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 14:38:47.169771 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 14:38:47.169771 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:38:47.169771 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:38:47.169771 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:38:47.169771 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:38:47.169771 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:38:47.169771 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:38:47.169771 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:38:47.169771 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application with Lock( Jul 26 14:38:47.169771 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:38:47.169771 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:38:47.169771 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:38:47.169771 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:38:47.171477 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:38:47.171477 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:38:47.171477 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:38:47.171477 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:38:47.171477 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 14:38:47.171477 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 14:38:47.171477 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 14:38:47.171477 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 14:38:47.171477 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 14:38:47.171477 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 14:38:47.171477 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 26 14:38:47.171477 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Jul 26 14:38:47.174389 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 318/647] 10.222.0.93 () {56 vars in 1102 bytes} [Tue Jul 26 14:38:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:38:47.175820 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238b3677-5e7e-47aa-a120-86f1d9dcb280 None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:47.211866 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:38:47.301889 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:38:47.332622 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13bb01b-bac9-4256-8428-0c3895c70458 None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:47.369283 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238b3677-5e7e-47aa-a120-86f1d9dcb280 None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:47.404503 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61a5aa7-9d84-4254-b8e5-9b0d0859657b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:47.405559 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61a5aa7-9d84-4254-b8e5-9b0d0859657b None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:47.406292 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61a5aa7-9d84-4254-b8e5-9b0d0859657b None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:47.406827 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61a5aa7-9d84-4254-b8e5-9b0d0859657b None admin] PATH_INFO: `/v3/users` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:47.408665 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61a5aa7-9d84-4254-b8e5-9b0d0859657b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:38:47.409199 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61a5aa7-9d84-4254-b8e5-9b0d0859657b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:38:47.411867 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61a5aa7-9d84-4254-b8e5-9b0d0859657b None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:38:47.416705 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05161d2-5d0e-4d6a-a0c4-2cb0a98c0905 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:47.417469 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05161d2-5d0e-4d6a-a0c4-2cb0a98c0905 None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:47.417916 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05161d2-5d0e-4d6a-a0c4-2cb0a98c0905 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:47.418370 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05161d2-5d0e-4d6a-a0c4-2cb0a98c0905 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:47.426841 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05161d2-5d0e-4d6a-a0c4-2cb0a98c0905 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:38:47.428634 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05161d2-5d0e-4d6a-a0c4-2cb0a98c0905 None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:38:47.449751 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 330/648] 10.222.0.93 () {56 vars in 1133 bytes} [Tue Jul 26 14:38:47 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:38:47.449751 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61a5aa7-9d84-4254-b8e5-9b0d0859657b None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:47.450169 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application [None req-b05161d2-5d0e-4d6a-a0c4-2cb0a98c0905 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 14:38:47.450169 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:38:47.450169 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:38:47.450169 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:38:47.450169 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:38:47.450169 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:38:47.450169 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:38:47.450169 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:38:47.450169 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:38:47.450169 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:38:47.450169 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:38:47.450169 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:38:47.450169 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 14:38:47.450169 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 14:38:47.450169 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 14:38:47.451897 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 14:38:47.451897 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:38:47.451897 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:38:47.451897 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:38:47.451897 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:38:47.451897 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:38:47.451897 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:38:47.451897 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:38:47.451897 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application with Lock( Jul 26 14:38:47.451897 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:38:47.451897 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:38:47.451897 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:38:47.451897 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:38:47.451897 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:38:47.451897 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:38:47.451897 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:38:47.451897 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:38:47.453798 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 14:38:47.453798 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 14:38:47.453798 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 14:38:47.453798 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 14:38:47.453798 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 14:38:47.453798 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 14:38:47.453798 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 14:38:47.453798 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Jul 26 14:38:47.453798 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 319/649] 10.222.0.93 () {56 vars in 1111 bytes} [Tue Jul 26 14:38:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:38:47.453798 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05161d2-5d0e-4d6a-a0c4-2cb0a98c0905 None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:47.581400 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:38:47.590819 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61a5aa7-9d84-4254-b8e5-9b0d0859657b None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:47.627480 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05161d2-5d0e-4d6a-a0c4-2cb0a98c0905 None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:47.664461 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd135b9b-bdcc-4107-8543-b8da6e8f7c7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:47.665571 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd135b9b-bdcc-4107-8543-b8da6e8f7c7b None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:47.666031 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd135b9b-bdcc-4107-8543-b8da6e8f7c7b None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:47.666553 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd135b9b-bdcc-4107-8543-b8da6e8f7c7b None admin] PATH_INFO: `/v3/users/cinder` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:47.681110 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd135b9b-bdcc-4107-8543-b8da6e8f7c7b None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:38:47.683890 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd135b9b-bdcc-4107-8543-b8da6e8f7c7b None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:38:47.691236 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:38:47.704448 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b568c63-96a5-4b94-9cb0-187c696ce36f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:47.705439 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application [None req-dd135b9b-bdcc-4107-8543-b8da6e8f7c7b None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 26 14:38:47.705439 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:38:47.705439 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:38:47.705439 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:38:47.705439 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:38:47.705439 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:38:47.705439 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:38:47.705439 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:38:47.705439 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:38:47.705439 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:38:47.705439 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:38:47.705439 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:38:47.705439 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 14:38:47.705439 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 14:38:47.705439 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 14:38:47.705439 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 14:38:47.715108 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:38:47.715108 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:38:47.715108 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 14:38:47.715108 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 14:38:47.715108 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 14:38:47.715108 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 14:38:47.715108 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:38:47.715108 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:38:47.715108 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:38:47.715108 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:38:47.715108 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:38:47.715108 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application with Lock( Jul 26 14:38:47.715108 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:38:47.715108 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:38:47.715108 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:38:47.715108 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:38:47.715108 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:38:47.715108 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:38:47.716969 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:38:47.716969 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:38:47.716969 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 14:38:47.716969 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 14:38:47.716969 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 14:38:47.716969 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 14:38:47.716969 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 14:38:47.716969 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 14:38:47.716969 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 26 14:38:47.716969 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Jul 26 14:38:47.718008 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b568c63-96a5-4b94-9cb0-187c696ce36f None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:47.718008 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b568c63-96a5-4b94-9cb0-187c696ce36f None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:47.718008 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b568c63-96a5-4b94-9cb0-187c696ce36f None admin] PATH_INFO: `/v3/roles` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:47.719877 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 331/650] 10.222.0.93 () {56 vars in 1099 bytes} [Tue Jul 26 14:38:47 2022] GET /identity/v3/users/cinder => generated 84 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:38:47.720134 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b568c63-96a5-4b94-9cb0-187c696ce36f None admin] RBAC: Adding query filter params (name=service) {{(pid=87055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:38:47.720438 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd135b9b-bdcc-4107-8543-b8da6e8f7c7b None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:47.720673 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b568c63-96a5-4b94-9cb0-187c696ce36f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:38:47.720673 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b568c63-96a5-4b94-9cb0-187c696ce36f None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:38:47.735458 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 320/651] 10.222.0.93 () {56 vars in 1103 bytes} [Tue Jul 26 14:38:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:38:47.735458 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b568c63-96a5-4b94-9cb0-187c696ce36f None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:47.889983 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd135b9b-bdcc-4107-8543-b8da6e8f7c7b None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:47.940270 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b568c63-96a5-4b94-9cb0-187c696ce36f None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:47.951491 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2be855-4e7a-42d7-bc70-20379e37cdd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:47.952473 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2be855-4e7a-42d7-bc70-20379e37cdd7 None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:47.952924 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2be855-4e7a-42d7-bc70-20379e37cdd7 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:47.953363 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2be855-4e7a-42d7-bc70-20379e37cdd7 None admin] PATH_INFO: `/v3/projects` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:47.954621 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2be855-4e7a-42d7-bc70-20379e37cdd7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:38:47.955056 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2be855-4e7a-42d7-bc70-20379e37cdd7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:38:47.957558 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2be855-4e7a-42d7-bc70-20379e37cdd7 None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:38:47.986657 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 332/652] 10.222.0.93 () {56 vars in 1148 bytes} [Tue Jul 26 14:38:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:38:47.986657 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2be855-4e7a-42d7-bc70-20379e37cdd7 None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:48.010998 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f1d6ee-e188-4d27-90b9-dc83037f777b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:48.011931 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f1d6ee-e188-4d27-90b9-dc83037f777b None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:48.012427 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f1d6ee-e188-4d27-90b9-dc83037f777b None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:48.012859 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f1d6ee-e188-4d27-90b9-dc83037f777b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:48.025524 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:38:48.102091 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:38:48.125929 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f1d6ee-e188-4d27-90b9-dc83037f777b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:38:48.127446 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f1d6ee-e188-4d27-90b9-dc83037f777b None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:38:48.169278 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2be855-4e7a-42d7-bc70-20379e37cdd7 None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:48.210953 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4109ea-a7ec-4e18-a651-1569d77a4005 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:48.211594 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4109ea-a7ec-4e18-a651-1569d77a4005 None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:48.211878 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4109ea-a7ec-4e18-a651-1569d77a4005 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:48.212158 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4109ea-a7ec-4e18-a651-1569d77a4005 None admin] PATH_INFO: `/v3/users` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:48.212983 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4109ea-a7ec-4e18-a651-1569d77a4005 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=87056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:38:48.213285 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4109ea-a7ec-4e18-a651-1569d77a4005 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:38:48.214832 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4109ea-a7ec-4e18-a651-1569d77a4005 None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:38:48.239548 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 333/653] 10.222.0.93 () {56 vars in 1137 bytes} [Tue Jul 26 14:38:47 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:38:48.240141 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4109ea-a7ec-4e18-a651-1569d77a4005 None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:48.280135 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 321/654] 10.222.0.93 () {58 vars in 1282 bytes} [Tue Jul 26 14:38:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 551 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 14:38:48.280837 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f1d6ee-e188-4d27-90b9-dc83037f777b None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:48.338688 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:38:48.387691 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4109ea-a7ec-4e18-a651-1569d77a4005 None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:48.421508 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:38:48.444405 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f1d6ee-e188-4d27-90b9-dc83037f777b None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:48.454302 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31aff98-7b80-44a5-b55c-9a0246971b2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:48.455205 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31aff98-7b80-44a5-b55c-9a0246971b2f None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:48.455614 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31aff98-7b80-44a5-b55c-9a0246971b2f None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:48.456017 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31aff98-7b80-44a5-b55c-9a0246971b2f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:48.469528 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31aff98-7b80-44a5-b55c-9a0246971b2f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:38:48.471605 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31aff98-7b80-44a5-b55c-9a0246971b2f None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:38:48.493805 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application [None req-f31aff98-7b80-44a5-b55c-9a0246971b2f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:38:48.493805 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:38:48.493805 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:38:48.493805 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:38:48.493805 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:38:48.493805 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:38:48.493805 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:38:48.493805 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:38:48.493805 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:38:48.493805 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:38:48.493805 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:38:48.493805 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:38:48.493805 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 14:38:48.493805 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 14:38:48.493805 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 14:38:48.517633 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 14:38:48.517633 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:38:48.517633 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:38:48.517633 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:38:48.517633 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:38:48.517633 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:38:48.517633 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:38:48.517633 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:38:48.517633 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application with Lock( Jul 26 14:38:48.517633 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:38:48.517633 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:38:48.517633 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:38:48.517633 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:38:48.517633 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:38:48.517633 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:38:48.517633 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:38:48.517633 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:38:48.519687 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 14:38:48.519687 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 14:38:48.519687 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:38:48.519687 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Jul 26 14:38:48.519687 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 334/655] 10.222.0.93 () {56 vars in 1108 bytes} [Tue Jul 26 14:38:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:38:48.519687 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31aff98-7b80-44a5-b55c-9a0246971b2f None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:48.520441 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d26188-9b09-44a7-8d0e-8dd11495def4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:48.520441 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d26188-9b09-44a7-8d0e-8dd11495def4 None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:48.520917 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d26188-9b09-44a7-8d0e-8dd11495def4 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:48.521885 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d26188-9b09-44a7-8d0e-8dd11495def4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:48.523477 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d26188-9b09-44a7-8d0e-8dd11495def4 None admin] RBAC: Adding query filter params (role.id=2e45ca312cda4bef9263725ae1c6dab7, scope.project.id=c422a2290a14424da20e2841cbc1741d, user.id=38ab40a64fb7419ebb0476e0fa09a2bb) {{(pid=87055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:38:48.523978 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d26188-9b09-44a7-8d0e-8dd11495def4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:38:48.526644 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d26188-9b09-44a7-8d0e-8dd11495def4 None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:38:48.535736 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 322/656] 10.222.0.93 () {56 vars in 1374 bytes} [Tue Jul 26 14:38:48 2022] GET /identity/v3/role_assignments?user.id=38ab40a64fb7419ebb0476e0fa09a2bb&scope.project.id=c422a2290a14424da20e2841cbc1741d&role.id=2e45ca312cda4bef9263725ae1c6dab7 => generated 608 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:38:48.537845 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d26188-9b09-44a7-8d0e-8dd11495def4 None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:48.755001 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31aff98-7b80-44a5-b55c-9a0246971b2f None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:48.786541 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d26188-9b09-44a7-8d0e-8dd11495def4 None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:48.791084 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:38:48.832687 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dbd954-f366-4310-85f5-339b11708655 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:48.833728 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dbd954-f366-4310-85f5-339b11708655 None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:48.834769 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dbd954-f366-4310-85f5-339b11708655 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:48.835886 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dbd954-f366-4310-85f5-339b11708655 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:48.874466 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02e2cd0-c549-4f7c-b4d9-3c674321894f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:48.875934 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02e2cd0-c549-4f7c-b4d9-3c674321894f None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:48.876439 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02e2cd0-c549-4f7c-b4d9-3c674321894f None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:48.876934 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02e2cd0-c549-4f7c-b4d9-3c674321894f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:48.902012 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02e2cd0-c549-4f7c-b4d9-3c674321894f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:38:48.904172 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02e2cd0-c549-4f7c-b4d9-3c674321894f None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:38:48.921366 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:38:48.931644 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application [None req-f02e2cd0-c549-4f7c-b4d9-3c674321894f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:38:48.931644 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:38:48.931644 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:38:48.931644 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:38:48.931644 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:38:48.931644 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:38:48.931644 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:38:48.931644 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:38:48.931644 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:38:48.931644 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:38:48.931644 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:38:48.931644 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:38:48.931644 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 14:38:48.931644 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 14:38:48.931644 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 14:38:48.932908 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 14:38:48.932908 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:38:48.932908 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:38:48.932908 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:38:48.932908 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:38:48.932908 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:38:48.932908 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:38:48.932908 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:38:48.932908 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application with Lock( Jul 26 14:38:48.932908 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:38:48.932908 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:38:48.932908 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:38:48.932908 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:38:48.932908 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:38:48.932908 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:38:48.932908 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:38:48.932908 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:38:48.933797 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 14:38:48.933797 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 14:38:48.933797 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:38:48.933797 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Jul 26 14:38:48.936778 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 323/657] 10.222.0.93 () {56 vars in 1108 bytes} [Tue Jul 26 14:38:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 400 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:38:48.938148 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02e2cd0-c549-4f7c-b4d9-3c674321894f None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:48.990084 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6dbd954-f366-4310-85f5-339b11708655 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:38:48.994219 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6dbd954-f366-4310-85f5-339b11708655 None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:38:49.145708 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02e2cd0-c549-4f7c-b4d9-3c674321894f None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:49.180712 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 335/658] 10.222.0.93 () {58 vars in 1282 bytes} [Tue Jul 26 14:38:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 685 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 14:38:49.182032 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dbd954-f366-4310-85f5-339b11708655 None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:49.227932 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dfd70e-3a81-4ba3-b3ec-92a96feaed2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:49.228583 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dfd70e-3a81-4ba3-b3ec-92a96feaed2d None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:49.228860 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dfd70e-3a81-4ba3-b3ec-92a96feaed2d None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:49.229138 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dfd70e-3a81-4ba3-b3ec-92a96feaed2d None admin] PATH_INFO: `/v3/domains` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:49.229844 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82dfd70e-3a81-4ba3-b3ec-92a96feaed2d None admin] RBAC: Adding query filter params (name=Default) {{(pid=87055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:38:49.230147 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82dfd70e-3a81-4ba3-b3ec-92a96feaed2d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:38:49.231622 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82dfd70e-3a81-4ba3-b3ec-92a96feaed2d None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:38:49.246865 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 324/659] 10.222.0.93 () {56 vars in 1109 bytes} [Tue Jul 26 14:38:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:38:49.248111 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f880077-7414-451e-877b-4cff84088262 None None] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:49.248401 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f880077-7414-451e-877b-4cff84088262 None None] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:49.248674 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f880077-7414-451e-877b-4cff84088262 None None] PATH_INFO: `/` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:49.254485 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 325/660] 10.222.0.93 () {54 vars in 926 bytes} [Tue Jul 26 14:38:49 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:38:49.255487 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f880077-7414-451e-877b-4cff84088262 None None] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:49.281917 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:38:49.315482 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:38:49.373502 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dbd954-f366-4310-85f5-339b11708655 None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:49.445954 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25119fca-ada7-494c-bd02-9545b70019e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:49.447135 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25119fca-ada7-494c-bd02-9545b70019e4 None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:49.447639 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25119fca-ada7-494c-bd02-9545b70019e4 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:49.448146 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25119fca-ada7-494c-bd02-9545b70019e4 None admin] PATH_INFO: `/v3/domains` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:49.448965 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f880077-7414-451e-877b-4cff84088262 None None] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:49.449467 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25119fca-ada7-494c-bd02-9545b70019e4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:38:49.450085 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25119fca-ada7-494c-bd02-9545b70019e4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:38:49.452870 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25119fca-ada7-494c-bd02-9545b70019e4 None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:38:49.478163 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 336/661] 10.222.0.93 () {56 vars in 1109 bytes} [Tue Jul 26 14:38:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:38:49.480555 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afa5853-113a-4685-bc53-23faa68c58d0 None None] REQUEST_METHOD: `POST` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:49.481050 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afa5853-113a-4685-bc53-23faa68c58d0 None None] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:49.481541 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afa5853-113a-4685-bc53-23faa68c58d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:49.505168 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2479b19-ab8a-45c2-8016-f445a4760273 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:49.505997 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2479b19-ab8a-45c2-8016-f445a4760273 None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:49.506455 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2479b19-ab8a-45c2-8016-f445a4760273 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:49.506782 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2479b19-ab8a-45c2-8016-f445a4760273 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:49.514261 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.auth.core [None req-5afa5853-113a-4685-bc53-23faa68c58d0 None None] MFA Rules not processed for user `e5ef88cc058f425b882bcb87a1e1e75c`. Rule list: `[]` (Enabled: `True`). {{(pid=87056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:38:49.515509 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.fernet_utils [None req-5afa5853-113a-4685-bc53-23faa68c58d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:38:49.525733 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2479b19-ab8a-45c2-8016-f445a4760273 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:38:49.528690 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2479b19-ab8a-45c2-8016-f445a4760273 None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:38:49.560002 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application [None req-e2479b19-ab8a-45c2-8016-f445a4760273 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:38:49.560002 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:38:49.560002 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:38:49.560002 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:38:49.560002 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:38:49.560002 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:38:49.560002 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:38:49.560002 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:38:49.560002 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:38:49.560002 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:38:49.560002 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:38:49.560002 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:38:49.560002 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 14:38:49.560002 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 14:38:49.560002 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 14:38:49.561104 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 14:38:49.561104 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:38:49.561104 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:38:49.561104 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:38:49.561104 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:38:49.561104 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:38:49.561104 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:38:49.561104 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:38:49.561104 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application with Lock( Jul 26 14:38:49.561104 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:38:49.561104 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:38:49.561104 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:38:49.561104 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:38:49.561104 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:38:49.561104 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:38:49.561104 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:38:49.561104 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:38:49.562010 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 14:38:49.562010 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 14:38:49.562010 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:38:49.562010 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Jul 26 14:38:49.566636 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 326/662] 10.222.0.93 () {56 vars in 1108 bytes} [Tue Jul 26 14:38:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:38:49.568613 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2479b19-ab8a-45c2-8016-f445a4760273 None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:49.653104 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 337/663] 10.222.0.93 () {58 vars in 1023 bytes} [Tue Jul 26 14:38:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 14:38:49.653302 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afa5853-113a-4685-bc53-23faa68c58d0 None None] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:49.701751 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:38:49.765513 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2479b19-ab8a-45c2-8016-f445a4760273 None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:49.767636 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:38:49.827855 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afa5853-113a-4685-bc53-23faa68c58d0 None None] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:49.832974 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2e124e-e5ee-44e7-ab5f-f4d4d265059b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:49.834507 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2e124e-e5ee-44e7-ab5f-f4d4d265059b None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:49.835221 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2e124e-e5ee-44e7-ab5f-f4d4d265059b None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:49.835701 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2e124e-e5ee-44e7-ab5f-f4d4d265059b None admin] PATH_INFO: `/v3/users/neutron` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:49.851545 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2e124e-e5ee-44e7-ab5f-f4d4d265059b None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:38:49.854353 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2e124e-e5ee-44e7-ab5f-f4d4d265059b None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:38:49.873350 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1b5360-fcab-4ba6-991e-239fa1ecdc85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:49.874203 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1b5360-fcab-4ba6-991e-239fa1ecdc85 None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:49.874668 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1b5360-fcab-4ba6-991e-239fa1ecdc85 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:49.875071 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1b5360-fcab-4ba6-991e-239fa1ecdc85 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:49.876991 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application [None req-4a2e124e-e5ee-44e7-ab5f-f4d4d265059b None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 26 14:38:49.876991 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:38:49.876991 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:38:49.876991 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:38:49.876991 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:38:49.876991 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:38:49.876991 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:38:49.876991 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:38:49.876991 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:38:49.876991 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:38:49.876991 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:38:49.876991 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:38:49.876991 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 14:38:49.876991 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 14:38:49.876991 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 14:38:49.876991 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 14:38:49.878510 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:38:49.878510 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:38:49.878510 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 14:38:49.878510 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 14:38:49.878510 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 14:38:49.878510 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 14:38:49.878510 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:38:49.878510 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:38:49.878510 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:38:49.878510 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:38:49.878510 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:38:49.878510 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application with Lock( Jul 26 14:38:49.878510 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:38:49.878510 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:38:49.878510 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:38:49.878510 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:38:49.878510 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:38:49.878510 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:38:49.879775 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:38:49.879775 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:38:49.879775 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 14:38:49.879775 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 14:38:49.879775 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 14:38:49.879775 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 14:38:49.879775 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 14:38:49.879775 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 14:38:49.879775 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 26 14:38:49.879775 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Jul 26 14:38:49.879775 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 327/664] 10.222.0.93 () {56 vars in 1102 bytes} [Tue Jul 26 14:38:49 2022] GET /identity/v3/users/neutron => generated 85 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:38:49.882552 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2e124e-e5ee-44e7-ab5f-f4d4d265059b None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:49.892963 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1b5360-fcab-4ba6-991e-239fa1ecdc85 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:38:49.894755 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1b5360-fcab-4ba6-991e-239fa1ecdc85 None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:38:49.911076 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application [None req-0b1b5360-fcab-4ba6-991e-239fa1ecdc85 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 14:38:49.911076 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:38:49.911076 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:38:49.911076 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:38:49.911076 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:38:49.911076 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:38:49.911076 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:38:49.911076 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:38:49.911076 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:38:49.911076 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:38:49.911076 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:38:49.911076 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:38:49.911076 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 14:38:49.911076 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 14:38:49.911076 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 14:38:49.912836 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 14:38:49.912836 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:38:49.912836 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:38:49.912836 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:38:49.912836 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:38:49.912836 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:38:49.912836 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:38:49.912836 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:38:49.912836 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application with Lock( Jul 26 14:38:49.912836 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:38:49.912836 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:38:49.912836 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:38:49.912836 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:38:49.912836 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:38:49.912836 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:38:49.912836 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:38:49.912836 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:38:49.915708 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 14:38:49.915708 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 14:38:49.915708 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 14:38:49.915708 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 14:38:49.915708 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 14:38:49.915708 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 14:38:49.915708 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 14:38:49.915708 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Jul 26 14:38:49.915708 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 338/665] 10.222.0.93 () {56 vars in 1111 bytes} [Tue Jul 26 14:38:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:38:49.915708 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1b5360-fcab-4ba6-991e-239fa1ecdc85 None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:50.064309 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1b5360-fcab-4ba6-991e-239fa1ecdc85 None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:50.089850 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2e124e-e5ee-44e7-ab5f-f4d4d265059b None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:50.101206 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:38:50.118898 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5956496-5d3c-41a5-a014-38654e1a3c87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:50.119598 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5956496-5d3c-41a5-a014-38654e1a3c87 None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:50.119880 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5956496-5d3c-41a5-a014-38654e1a3c87 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:50.120155 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5956496-5d3c-41a5-a014-38654e1a3c87 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:50.143562 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5956496-5d3c-41a5-a014-38654e1a3c87 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 14:38:50.143832 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:38:50.149265 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application [None req-c5956496-5d3c-41a5-a014-38654e1a3c87 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 26 14:38:50.149265 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:38:50.149265 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:38:50.149265 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:38:50.149265 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:38:50.149265 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:38:50.149265 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:38:50.149265 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:38:50.149265 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:38:50.149265 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:38:50.149265 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:38:50.149265 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:38:50.149265 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 14:38:50.149265 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 14:38:50.149265 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 14:38:50.149265 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 14:38:50.151165 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 14:38:50.151165 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 14:38:50.151165 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 14:38:50.151165 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 14:38:50.151165 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:38:50.151165 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:38:50.151165 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:38:50.151165 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:38:50.151165 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:38:50.151165 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:38:50.151165 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:38:50.151165 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application with Lock( Jul 26 14:38:50.151165 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:38:50.151165 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:38:50.151165 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:38:50.151165 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:38:50.153278 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:38:50.153278 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:38:50.153278 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:38:50.153278 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:38:50.153278 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 14:38:50.153278 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 14:38:50.153278 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 14:38:50.153278 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 14:38:50.153278 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 14:38:50.153278 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 14:38:50.153278 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 26 14:38:50.153278 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Jul 26 14:38:50.155987 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 339/666] 10.222.0.93 () {56 vars in 1102 bytes} [Tue Jul 26 14:38:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:38:50.156845 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848e3d4b-1bc3-4674-99c0-f9a63b6a3ff6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:50.157074 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5956496-5d3c-41a5-a014-38654e1a3c87 None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:50.157783 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848e3d4b-1bc3-4674-99c0-f9a63b6a3ff6 None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:50.158051 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848e3d4b-1bc3-4674-99c0-f9a63b6a3ff6 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:50.158462 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848e3d4b-1bc3-4674-99c0-f9a63b6a3ff6 None admin] PATH_INFO: `/v3/domains` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:50.159193 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848e3d4b-1bc3-4674-99c0-f9a63b6a3ff6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:38:50.159552 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848e3d4b-1bc3-4674-99c0-f9a63b6a3ff6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:38:50.162997 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848e3d4b-1bc3-4674-99c0-f9a63b6a3ff6 None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:38:50.183984 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 328/667] 10.222.0.93 () {56 vars in 1109 bytes} [Tue Jul 26 14:38:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:38:50.184609 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848e3d4b-1bc3-4674-99c0-f9a63b6a3ff6 None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:50.320430 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5956496-5d3c-41a5-a014-38654e1a3c87 None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:50.359066 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848e3d4b-1bc3-4674-99c0-f9a63b6a3ff6 None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:50.382696 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc533fea-baaf-4447-b010-6a5f9cce755f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:50.392364 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc533fea-baaf-4447-b010-6a5f9cce755f None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:50.392364 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc533fea-baaf-4447-b010-6a5f9cce755f None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:50.392364 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc533fea-baaf-4447-b010-6a5f9cce755f None admin] PATH_INFO: `/v3/users` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:50.392364 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc533fea-baaf-4447-b010-6a5f9cce755f None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=87056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:38:50.392364 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc533fea-baaf-4447-b010-6a5f9cce755f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:38:50.392364 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc533fea-baaf-4447-b010-6a5f9cce755f None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:38:50.420991 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 340/668] 10.222.0.93 () {56 vars in 1139 bytes} [Tue Jul 26 14:38:50 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:38:50.422129 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc533fea-baaf-4447-b010-6a5f9cce755f None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:50.438285 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadb66d4-6748-46eb-b24d-3a824899b1ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:50.439839 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadb66d4-6748-46eb-b24d-3a824899b1ae None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:50.440638 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadb66d4-6748-46eb-b24d-3a824899b1ae None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:50.441211 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadb66d4-6748-46eb-b24d-3a824899b1ae None admin] PATH_INFO: `/v3/projects` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:50.442745 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadb66d4-6748-46eb-b24d-3a824899b1ae None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:38:50.444022 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadb66d4-6748-46eb-b24d-3a824899b1ae None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:38:50.447087 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadb66d4-6748-46eb-b24d-3a824899b1ae None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:38:50.471301 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 329/669] 10.222.0.93 () {56 vars in 1148 bytes} [Tue Jul 26 14:38:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:38:50.472542 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadb66d4-6748-46eb-b24d-3a824899b1ae None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:50.491852 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:38:50.543576 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:38:50.623865 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc533fea-baaf-4447-b010-6a5f9cce755f None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:50.644501 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadb66d4-6748-46eb-b24d-3a824899b1ae None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:50.708316 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdd3702-7090-45e3-b52d-4555546477b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:50.709472 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdd3702-7090-45e3-b52d-4555546477b9 None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:50.709972 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdd3702-7090-45e3-b52d-4555546477b9 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:50.710495 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdd3702-7090-45e3-b52d-4555546477b9 None admin] PATH_INFO: `/v3/roles` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:50.711858 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdd3702-7090-45e3-b52d-4555546477b9 None admin] RBAC: Adding query filter params (name=service) {{(pid=87056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:38:50.712387 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdd3702-7090-45e3-b52d-4555546477b9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:38:50.714988 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdd3702-7090-45e3-b52d-4555546477b9 None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:38:50.718967 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a022f89-52a8-44d9-b437-0107dc2c8612 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:50.720504 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a022f89-52a8-44d9-b437-0107dc2c8612 None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:50.721310 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a022f89-52a8-44d9-b437-0107dc2c8612 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:50.722063 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a022f89-52a8-44d9-b437-0107dc2c8612 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:50.733378 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 341/670] 10.222.0.93 () {56 vars in 1103 bytes} [Tue Jul 26 14:38:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:38:50.735389 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdd3702-7090-45e3-b52d-4555546477b9 None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:50.742484 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a022f89-52a8-44d9-b437-0107dc2c8612 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:38:50.746479 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a022f89-52a8-44d9-b437-0107dc2c8612 None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:38:50.773555 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application [None req-9a022f89-52a8-44d9-b437-0107dc2c8612 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 14:38:50.773555 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:38:50.773555 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:38:50.773555 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:38:50.773555 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:38:50.773555 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:38:50.773555 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:38:50.773555 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:38:50.773555 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:38:50.773555 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:38:50.773555 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:38:50.773555 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:38:50.773555 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 14:38:50.773555 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 14:38:50.773555 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 14:38:50.774746 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 14:38:50.774746 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:38:50.774746 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:38:50.774746 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:38:50.774746 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:38:50.774746 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:38:50.774746 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:38:50.774746 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:38:50.774746 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application with Lock( Jul 26 14:38:50.774746 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:38:50.774746 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:38:50.774746 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:38:50.774746 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:38:50.774746 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:38:50.774746 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:38:50.774746 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:38:50.774746 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:38:50.775884 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 14:38:50.775884 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 14:38:50.775884 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 14:38:50.775884 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 14:38:50.775884 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 14:38:50.775884 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 14:38:50.775884 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 14:38:50.775884 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Jul 26 14:38:50.776382 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 330/671] 10.222.0.93 () {56 vars in 1111 bytes} [Tue Jul 26 14:38:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:38:50.777857 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a022f89-52a8-44d9-b437-0107dc2c8612 None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:50.919956 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:38:50.924595 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdd3702-7090-45e3-b52d-4555546477b9 None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:50.981617 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d21672-2b7b-4d75-9ccd-268aa14c04be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:50.982894 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d21672-2b7b-4d75-9ccd-268aa14c04be None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:50.983596 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d21672-2b7b-4d75-9ccd-268aa14c04be None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:50.984329 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d21672-2b7b-4d75-9ccd-268aa14c04be None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:50.991968 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a022f89-52a8-44d9-b437-0107dc2c8612 None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:51.007848 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:38:51.057405 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d6bdd2-b9d5-46f9-8a9d-058fb91882d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:51.058431 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d6bdd2-b9d5-46f9-8a9d-058fb91882d9 None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:51.058855 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d6bdd2-b9d5-46f9-8a9d-058fb91882d9 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:51.059271 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d6bdd2-b9d5-46f9-8a9d-058fb91882d9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:51.060581 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d6bdd2-b9d5-46f9-8a9d-058fb91882d9 None admin] RBAC: Adding query filter params (role.id=2e45ca312cda4bef9263725ae1c6dab7, scope.project.id=c422a2290a14424da20e2841cbc1741d, user.id=2e86fe36c9bf49a481c9f15ac7571b88) {{(pid=87055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:38:51.061183 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d6bdd2-b9d5-46f9-8a9d-058fb91882d9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:38:51.064011 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d6bdd2-b9d5-46f9-8a9d-058fb91882d9 None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:38:51.076540 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 331/672] 10.222.0.93 () {56 vars in 1374 bytes} [Tue Jul 26 14:38:50 2022] GET /identity/v3/role_assignments?user.id=2e86fe36c9bf49a481c9f15ac7571b88&scope.project.id=c422a2290a14424da20e2841cbc1741d&role.id=2e45ca312cda4bef9263725ae1c6dab7 => generated 608 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:38:51.077550 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d6bdd2-b9d5-46f9-8a9d-058fb91882d9 None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:51.130075 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d21672-2b7b-4d75-9ccd-268aa14c04be None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:38:51.133664 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d21672-2b7b-4d75-9ccd-268aa14c04be None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:38:51.320859 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d6bdd2-b9d5-46f9-8a9d-058fb91882d9 None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:51.347400 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:38:51.358756 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 342/673] 10.222.0.93 () {58 vars in 1282 bytes} [Tue Jul 26 14:38:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 620 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 14:38:51.358756 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d21672-2b7b-4d75-9ccd-268aa14c04be None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:51.391523 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342e04a9-4561-4b68-adcb-6b7ee898c252 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:51.392898 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342e04a9-4561-4b68-adcb-6b7ee898c252 None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:51.393098 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342e04a9-4561-4b68-adcb-6b7ee898c252 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:51.393403 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342e04a9-4561-4b68-adcb-6b7ee898c252 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:51.411726 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342e04a9-4561-4b68-adcb-6b7ee898c252 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:38:51.413842 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342e04a9-4561-4b68-adcb-6b7ee898c252 None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:38:51.434400 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application [None req-342e04a9-4561-4b68-adcb-6b7ee898c252 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:38:51.434400 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:38:51.434400 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:38:51.434400 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:38:51.434400 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:38:51.434400 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:38:51.434400 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:38:51.434400 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:38:51.434400 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:38:51.434400 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:38:51.434400 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:38:51.434400 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:38:51.434400 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 14:38:51.434400 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 14:38:51.434400 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 14:38:51.436169 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 14:38:51.436169 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:38:51.436169 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:38:51.436169 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:38:51.436169 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:38:51.436169 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:38:51.436169 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:38:51.436169 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:38:51.436169 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application with Lock( Jul 26 14:38:51.436169 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:38:51.436169 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:38:51.436169 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:38:51.436169 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:38:51.436169 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:38:51.436169 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:38:51.436169 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:38:51.436169 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:38:51.437979 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 14:38:51.437979 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 14:38:51.437979 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:38:51.437979 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Jul 26 14:38:51.438706 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 332/674] 10.222.0.93 () {56 vars in 1108 bytes} [Tue Jul 26 14:38:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 361 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:38:51.439788 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342e04a9-4561-4b68-adcb-6b7ee898c252 None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:51.478987 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:38:51.544922 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d21672-2b7b-4d75-9ccd-268aa14c04be None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:51.590303 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233d6883-9d13-480e-a62b-fce4ff1ddb45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:51.590834 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233d6883-9d13-480e-a62b-fce4ff1ddb45 None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:51.591115 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233d6883-9d13-480e-a62b-fce4ff1ddb45 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:51.591382 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233d6883-9d13-480e-a62b-fce4ff1ddb45 None admin] PATH_INFO: `/v3/projects` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:51.592212 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233d6883-9d13-480e-a62b-fce4ff1ddb45 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:38:51.592455 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233d6883-9d13-480e-a62b-fce4ff1ddb45 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:38:51.593935 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233d6883-9d13-480e-a62b-fce4ff1ddb45 None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:38:51.619321 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 343/675] 10.222.0.93 () {56 vars in 1148 bytes} [Tue Jul 26 14:38:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:38:51.619321 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c4cfb6-ec33-464d-9765-9cc69d9ce30f None None] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:51.619321 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c4cfb6-ec33-464d-9765-9cc69d9ce30f None None] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:51.619321 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c4cfb6-ec33-464d-9765-9cc69d9ce30f None None] PATH_INFO: `/` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:51.619321 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 344/676] 10.222.0.93 () {54 vars in 926 bytes} [Tue Jul 26 14:38:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:38:51.619321 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c4cfb6-ec33-464d-9765-9cc69d9ce30f None None] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:51.634466 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342e04a9-4561-4b68-adcb-6b7ee898c252 None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:51.703317 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6389f57-bc40-46aa-950f-07d27e37db3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:51.704404 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6389f57-bc40-46aa-950f-07d27e37db3d None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:51.704895 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6389f57-bc40-46aa-950f-07d27e37db3d None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:51.705655 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6389f57-bc40-46aa-950f-07d27e37db3d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:51.725182 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:38:51.726203 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6389f57-bc40-46aa-950f-07d27e37db3d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:38:51.729011 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6389f57-bc40-46aa-950f-07d27e37db3d None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:38:51.756925 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application [None req-f6389f57-bc40-46aa-950f-07d27e37db3d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:38:51.756925 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:38:51.756925 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:38:51.756925 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:38:51.756925 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:38:51.756925 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:38:51.756925 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:38:51.756925 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:38:51.756925 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:38:51.756925 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:38:51.756925 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:38:51.756925 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:38:51.756925 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 14:38:51.756925 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 14:38:51.756925 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 14:38:51.757999 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 14:38:51.757999 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:38:51.757999 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:38:51.757999 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:38:51.757999 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:38:51.757999 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:38:51.757999 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:38:51.757999 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:38:51.757999 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application with Lock( Jul 26 14:38:51.757999 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:38:51.757999 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:38:51.757999 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:38:51.757999 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:38:51.757999 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:38:51.757999 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:38:51.757999 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:38:51.757999 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:38:51.759109 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 14:38:51.759109 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 14:38:51.759109 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:38:51.759109 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Jul 26 14:38:51.768123 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 333/677] 10.222.0.93 () {56 vars in 1108 bytes} [Tue Jul 26 14:38:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 327 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:38:51.770639 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c99edb8-46db-4b33-ad49-e3a2433e7cca None None] REQUEST_METHOD: `POST` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:51.771647 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c99edb8-46db-4b33-ad49-e3a2433e7cca None None] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:51.773095 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c99edb8-46db-4b33-ad49-e3a2433e7cca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:51.792169 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c4cfb6-ec33-464d-9765-9cc69d9ce30f None None] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:51.803851 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.auth.core [None req-2c99edb8-46db-4b33-ad49-e3a2433e7cca None None] MFA Rules not processed for user `e5ef88cc058f425b882bcb87a1e1e75c`. Rule list: `[]` (Enabled: `True`). {{(pid=87055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:38:51.806034 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.fernet_utils [None req-2c99edb8-46db-4b33-ad49-e3a2433e7cca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:38:51.862083 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e176ad-06d9-418c-b763-831709a447fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:51.863195 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e176ad-06d9-418c-b763-831709a447fc None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:51.863697 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e176ad-06d9-418c-b763-831709a447fc None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:51.864188 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e176ad-06d9-418c-b763-831709a447fc None admin] PATH_INFO: `/v3/domains` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:51.865571 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e176ad-06d9-418c-b763-831709a447fc None admin] RBAC: Adding query filter params (name=Default) {{(pid=87056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:38:51.866144 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e176ad-06d9-418c-b763-831709a447fc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:38:51.868915 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e176ad-06d9-418c-b763-831709a447fc None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:38:51.902577 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 345/678] 10.222.0.93 () {56 vars in 1109 bytes} [Tue Jul 26 14:38:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:38:51.902577 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e176ad-06d9-418c-b763-831709a447fc None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:51.914395 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 334/679] 10.222.0.93 () {58 vars in 1023 bytes} [Tue Jul 26 14:38:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 14:38:51.914395 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c99edb8-46db-4b33-ad49-e3a2433e7cca None None] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:51.919665 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:38:52.060526 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c99edb8-46db-4b33-ad49-e3a2433e7cca None None] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:52.111927 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e176ad-06d9-418c-b763-831709a447fc None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:52.116408 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cafe5f-9100-4b9f-b3b1-bb441f3a4d28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:52.117419 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cafe5f-9100-4b9f-b3b1-bb441f3a4d28 None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:52.117948 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cafe5f-9100-4b9f-b3b1-bb441f3a4d28 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:52.118520 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cafe5f-9100-4b9f-b3b1-bb441f3a4d28 None admin] PATH_INFO: `/v3/domains` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:52.119773 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cafe5f-9100-4b9f-b3b1-bb441f3a4d28 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:38:52.120265 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cafe5f-9100-4b9f-b3b1-bb441f3a4d28 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:38:52.123073 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cafe5f-9100-4b9f-b3b1-bb441f3a4d28 None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:38:52.138353 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:38:52.146187 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 335/680] 10.222.0.93 () {56 vars in 1109 bytes} [Tue Jul 26 14:38:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:38:52.147772 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cafe5f-9100-4b9f-b3b1-bb441f3a4d28 None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:52.175263 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274ba86d-b7f0-49d4-9d52-8069ef7329ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:52.176252 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274ba86d-b7f0-49d4-9d52-8069ef7329ee None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:52.176664 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274ba86d-b7f0-49d4-9d52-8069ef7329ee None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:52.177110 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274ba86d-b7f0-49d4-9d52-8069ef7329ee None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:52.179158 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274ba86d-b7f0-49d4-9d52-8069ef7329ee None admin] RBAC: Adding query filter params (role.id=2e45ca312cda4bef9263725ae1c6dab7, scope.project.id=c422a2290a14424da20e2841cbc1741d, user.id=6780136eb21e4c8da1950b126284639e) {{(pid=87056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:38:52.179663 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274ba86d-b7f0-49d4-9d52-8069ef7329ee None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:38:52.182006 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274ba86d-b7f0-49d4-9d52-8069ef7329ee None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:38:52.192041 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 346/681] 10.222.0.93 () {56 vars in 1374 bytes} [Tue Jul 26 14:38:51 2022] GET /identity/v3/role_assignments?user.id=6780136eb21e4c8da1950b126284639e&scope.project.id=c422a2290a14424da20e2841cbc1741d&role.id=2e45ca312cda4bef9263725ae1c6dab7 => generated 608 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:38:52.203815 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274ba86d-b7f0-49d4-9d52-8069ef7329ee None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:52.307156 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:38:52.392062 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cafe5f-9100-4b9f-b3b1-bb441f3a4d28 None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:52.451034 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274ba86d-b7f0-49d4-9d52-8069ef7329ee None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:52.476407 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a750af-b34f-4b33-9199-221385034c5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:52.477319 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a750af-b34f-4b33-9199-221385034c5d None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:52.477725 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a750af-b34f-4b33-9199-221385034c5d None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:52.478141 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a750af-b34f-4b33-9199-221385034c5d None admin] PATH_INFO: `/v3/users/swift` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:52.493234 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a750af-b34f-4b33-9199-221385034c5d None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:38:52.495970 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a750af-b34f-4b33-9199-221385034c5d None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:38:52.518389 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application [None req-87a750af-b34f-4b33-9199-221385034c5d None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 26 14:38:52.518389 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:38:52.518389 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:38:52.518389 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:38:52.518389 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:38:52.518389 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:38:52.518389 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:38:52.518389 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:38:52.518389 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:38:52.518389 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:38:52.518389 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:38:52.518389 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:38:52.518389 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 14:38:52.518389 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 14:38:52.518389 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 14:38:52.518389 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 14:38:52.520232 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:38:52.520232 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:38:52.520232 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 14:38:52.520232 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 14:38:52.520232 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 14:38:52.520232 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 14:38:52.520232 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:38:52.520232 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:38:52.520232 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:38:52.520232 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:38:52.520232 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:38:52.520232 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application with Lock( Jul 26 14:38:52.520232 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:38:52.520232 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:38:52.520232 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:38:52.520232 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:38:52.520232 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:38:52.520232 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:38:52.522044 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:38:52.522044 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:38:52.522044 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 14:38:52.522044 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 14:38:52.522044 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 14:38:52.522044 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 14:38:52.522044 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 14:38:52.522044 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 14:38:52.522044 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 26 14:38:52.522044 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Jul 26 14:38:52.522044 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 336/682] 10.222.0.93 () {56 vars in 1096 bytes} [Tue Jul 26 14:38:52 2022] GET /identity/v3/users/swift => generated 83 bytes in 374 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:38:52.523218 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a750af-b34f-4b33-9199-221385034c5d None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:52.530450 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd5c1e7-b33b-452f-b1ff-6b70b9321736 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:52.530450 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd5c1e7-b33b-452f-b1ff-6b70b9321736 None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:52.530450 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd5c1e7-b33b-452f-b1ff-6b70b9321736 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:52.531361 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd5c1e7-b33b-452f-b1ff-6b70b9321736 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:52.554670 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd5c1e7-b33b-452f-b1ff-6b70b9321736 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:38:52.558663 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd5c1e7-b33b-452f-b1ff-6b70b9321736 None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:38:52.581304 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application [None req-8cd5c1e7-b33b-452f-b1ff-6b70b9321736 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:38:52.581304 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:38:52.581304 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:38:52.581304 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:38:52.581304 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:38:52.581304 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:38:52.581304 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:38:52.581304 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:38:52.581304 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:38:52.581304 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:38:52.581304 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:38:52.581304 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:38:52.581304 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 14:38:52.581304 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 14:38:52.581304 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 14:38:52.583012 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 14:38:52.583012 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:38:52.583012 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:38:52.583012 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:38:52.583012 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:38:52.583012 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:38:52.583012 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:38:52.583012 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:38:52.583012 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application with Lock( Jul 26 14:38:52.583012 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:38:52.583012 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:38:52.583012 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:38:52.583012 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:38:52.583012 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:38:52.583012 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:38:52.583012 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:38:52.583012 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:38:52.584691 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 14:38:52.584691 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 14:38:52.584691 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:38:52.584691 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Jul 26 14:38:52.584691 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 347/683] 10.222.0.93 () {56 vars in 1108 bytes} [Tue Jul 26 14:38:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 380 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:38:52.584691 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd5c1e7-b33b-452f-b1ff-6b70b9321736 None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:52.655885 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:38:52.753557 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a750af-b34f-4b33-9199-221385034c5d None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:52.762018 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd5c1e7-b33b-452f-b1ff-6b70b9321736 None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:52.805108 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:38:52.817934 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d896da5d-8c98-4c9d-968d-887a71bdc38b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:52.819081 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d896da5d-8c98-4c9d-968d-887a71bdc38b None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:52.819550 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d896da5d-8c98-4c9d-968d-887a71bdc38b None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:52.820057 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d896da5d-8c98-4c9d-968d-887a71bdc38b None admin] PATH_INFO: `/v3/users` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:52.820959 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d896da5d-8c98-4c9d-968d-887a71bdc38b None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=87056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:38:52.821273 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d896da5d-8c98-4c9d-968d-887a71bdc38b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:38:52.822915 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d896da5d-8c98-4c9d-968d-887a71bdc38b None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:38:52.827668 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac1e358-3f52-458c-b98f-a28a82a183b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:52.829189 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac1e358-3f52-458c-b98f-a28a82a183b7 None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:52.829973 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac1e358-3f52-458c-b98f-a28a82a183b7 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:52.830759 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac1e358-3f52-458c-b98f-a28a82a183b7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:52.844462 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac1e358-3f52-458c-b98f-a28a82a183b7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:38:52.853629 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 348/684] 10.222.0.93 () {56 vars in 1135 bytes} [Tue Jul 26 14:38:52 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:38:52.853629 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d896da5d-8c98-4c9d-968d-887a71bdc38b None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:52.854023 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac1e358-3f52-458c-b98f-a28a82a183b7 None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:38:52.875248 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application [None req-3ac1e358-3f52-458c-b98f-a28a82a183b7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 14:38:52.875248 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:38:52.875248 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:38:52.875248 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:38:52.875248 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:38:52.875248 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:38:52.875248 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:38:52.875248 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:38:52.875248 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:38:52.875248 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:38:52.875248 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:38:52.875248 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:38:52.875248 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 14:38:52.875248 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 14:38:52.875248 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 14:38:52.877242 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 14:38:52.877242 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:38:52.877242 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:38:52.877242 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:38:52.877242 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:38:52.877242 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:38:52.877242 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:38:52.877242 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:38:52.877242 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application with Lock( Jul 26 14:38:52.877242 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:38:52.877242 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:38:52.877242 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:38:52.877242 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:38:52.877242 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:38:52.877242 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:38:52.877242 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:38:52.877242 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:38:52.879396 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 14:38:52.879396 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 14:38:52.879396 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 14:38:52.879396 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 14:38:52.879396 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 14:38:52.879396 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 14:38:52.879396 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 14:38:52.879396 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Jul 26 14:38:52.879396 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 337/685] 10.222.0.93 () {56 vars in 1111 bytes} [Tue Jul 26 14:38:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 357 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:38:52.881002 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac1e358-3f52-458c-b98f-a28a82a183b7 None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:53.042849 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac1e358-3f52-458c-b98f-a28a82a183b7 None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:53.100649 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:38:53.119066 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29eb352-9b0c-4820-a170-e4ee6b80173d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:53.119758 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29eb352-9b0c-4820-a170-e4ee6b80173d None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:53.120042 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29eb352-9b0c-4820-a170-e4ee6b80173d None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:53.120319 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29eb352-9b0c-4820-a170-e4ee6b80173d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:53.121596 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d896da5d-8c98-4c9d-968d-887a71bdc38b None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:53.206272 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c73ecfb-5913-45bb-9d01-55a14bafce7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:53.206547 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c73ecfb-5913-45bb-9d01-55a14bafce7c None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:53.206735 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c73ecfb-5913-45bb-9d01-55a14bafce7c None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:53.207080 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c73ecfb-5913-45bb-9d01-55a14bafce7c None admin] PATH_INFO: `/v3/domains` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:53.207758 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c73ecfb-5913-45bb-9d01-55a14bafce7c None admin] RBAC: Adding query filter params (name=Default) {{(pid=87056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:38:53.208066 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c73ecfb-5913-45bb-9d01-55a14bafce7c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:38:53.210195 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c73ecfb-5913-45bb-9d01-55a14bafce7c None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:38:53.224457 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:38:53.230282 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 349/686] 10.222.0.93 () {56 vars in 1109 bytes} [Tue Jul 26 14:38:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 378 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:38:53.230282 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c73ecfb-5913-45bb-9d01-55a14bafce7c None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:53.275014 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29eb352-9b0c-4820-a170-e4ee6b80173d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:38:53.280109 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29eb352-9b0c-4820-a170-e4ee6b80173d None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:38:53.431749 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c73ecfb-5913-45bb-9d01-55a14bafce7c None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:53.442284 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 338/687] 10.222.0.93 () {58 vars in 1282 bytes} [Tue Jul 26 14:38:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 556 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 14:38:53.442284 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29eb352-9b0c-4820-a170-e4ee6b80173d None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:53.509543 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f425fa55-d0df-4c2e-89e3-a92fa2c062c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:53.511206 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f425fa55-d0df-4c2e-89e3-a92fa2c062c3 None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:53.512033 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f425fa55-d0df-4c2e-89e3-a92fa2c062c3 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:53.512844 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f425fa55-d0df-4c2e-89e3-a92fa2c062c3 None admin] PATH_INFO: `/v3/projects` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:53.514654 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f425fa55-d0df-4c2e-89e3-a92fa2c062c3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:38:53.515612 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f425fa55-d0df-4c2e-89e3-a92fa2c062c3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:38:53.518705 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f425fa55-d0df-4c2e-89e3-a92fa2c062c3 None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:38:53.544588 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 350/688] 10.222.0.93 () {56 vars in 1148 bytes} [Tue Jul 26 14:38:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:38:53.546592 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f425fa55-d0df-4c2e-89e3-a92fa2c062c3 None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:53.565921 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:38:53.579514 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:38:53.588132 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29eb352-9b0c-4820-a170-e4ee6b80173d None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:53.630380 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918a2138-b0cc-479c-a26c-de730bc6e48d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:53.631298 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918a2138-b0cc-479c-a26c-de730bc6e48d None admin] REQUEST_METHOD: `POST` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:53.631665 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918a2138-b0cc-479c-a26c-de730bc6e48d None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:53.631946 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918a2138-b0cc-479c-a26c-de730bc6e48d None admin] PATH_INFO: `/v3/users` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:53.636550 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918a2138-b0cc-479c-a26c-de730bc6e48d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:38:53.636550 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918a2138-b0cc-479c-a26c-de730bc6e48d None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:38:53.685792 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f425fa55-d0df-4c2e-89e3-a92fa2c062c3 None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:53.731587 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8078ec-d58d-4502-9e04-c61e973937c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:53.732253 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8078ec-d58d-4502-9e04-c61e973937c9 None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:53.732572 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8078ec-d58d-4502-9e04-c61e973937c9 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:53.732811 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8078ec-d58d-4502-9e04-c61e973937c9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:53.748366 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8078ec-d58d-4502-9e04-c61e973937c9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:38:53.750044 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8078ec-d58d-4502-9e04-c61e973937c9 None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:38:53.754455 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 339/689] 10.222.0.93 () {60 vars in 1132 bytes} [Tue Jul 26 14:38:53 2022] POST /identity/v3/users => generated 254 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 14:38:53.756204 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918a2138-b0cc-479c-a26c-de730bc6e48d None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:53.789426 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application [None req-3b8078ec-d58d-4502-9e04-c61e973937c9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:38:53.789426 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:38:53.789426 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:38:53.789426 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:38:53.789426 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:38:53.789426 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:38:53.789426 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:38:53.789426 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:38:53.789426 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:38:53.789426 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:38:53.789426 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:38:53.789426 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:38:53.789426 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 14:38:53.789426 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 14:38:53.789426 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 14:38:53.790503 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 14:38:53.790503 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:38:53.790503 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:38:53.790503 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:38:53.790503 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:38:53.790503 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:38:53.790503 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:38:53.790503 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:38:53.790503 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application with Lock( Jul 26 14:38:53.790503 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:38:53.790503 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:38:53.790503 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:38:53.790503 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:38:53.790503 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:38:53.790503 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:38:53.790503 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:38:53.790503 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:38:53.791535 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 14:38:53.791535 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 14:38:53.791535 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:38:53.791535 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Jul 26 14:38:53.794403 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 351/690] 10.222.0.93 () {56 vars in 1108 bytes} [Tue Jul 26 14:38:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:38:53.814609 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8078ec-d58d-4502-9e04-c61e973937c9 None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:54.016181 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:38:54.071053 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918a2138-b0cc-479c-a26c-de730bc6e48d None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:54.142549 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2886aece-e18e-4cd8-b4e2-68807ac93705 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:54.143194 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2886aece-e18e-4cd8-b4e2-68807ac93705 None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:54.143475 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2886aece-e18e-4cd8-b4e2-68807ac93705 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:54.143748 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2886aece-e18e-4cd8-b4e2-68807ac93705 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:54.144556 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2886aece-e18e-4cd8-b4e2-68807ac93705 None admin] RBAC: Adding query filter params (role.id=2e45ca312cda4bef9263725ae1c6dab7, scope.project.id=c422a2290a14424da20e2841cbc1741d, user.id=541dcf2b85a145e99c7d0663a0ac0918) {{(pid=87055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:38:54.144868 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2886aece-e18e-4cd8-b4e2-68807ac93705 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:38:54.146952 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2886aece-e18e-4cd8-b4e2-68807ac93705 None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:38:54.154204 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 340/691] 10.222.0.93 () {56 vars in 1374 bytes} [Tue Jul 26 14:38:53 2022] GET /identity/v3/role_assignments?user.id=541dcf2b85a145e99c7d0663a0ac0918&scope.project.id=c422a2290a14424da20e2841cbc1741d&role.id=2e45ca312cda4bef9263725ae1c6dab7 => generated 608 bytes in 399 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:38:54.155923 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8078ec-d58d-4502-9e04-c61e973937c9 None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:54.213472 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4bc2c0-3089-4e48-a071-c6e7a3c255d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:54.214437 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4bc2c0-3089-4e48-a071-c6e7a3c255d3 None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:54.214899 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4bc2c0-3089-4e48-a071-c6e7a3c255d3 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:54.215321 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4bc2c0-3089-4e48-a071-c6e7a3c255d3 None admin] PATH_INFO: `/v3/domains` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:54.216259 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4bc2c0-3089-4e48-a071-c6e7a3c255d3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:38:54.216720 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4bc2c0-3089-4e48-a071-c6e7a3c255d3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:38:54.218533 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4bc2c0-3089-4e48-a071-c6e7a3c255d3 None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:38:54.240248 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 352/692] 10.222.0.93 () {56 vars in 1109 bytes} [Tue Jul 26 14:38:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 422 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:38:54.243587 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2886aece-e18e-4cd8-b4e2-68807ac93705 None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:54.250742 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:38:54.267185 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e1918c-d908-4248-9a0c-5f94218a5307 None None] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:54.267851 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e1918c-d908-4248-9a0c-5f94218a5307 None None] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:54.268376 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e1918c-d908-4248-9a0c-5f94218a5307 None None] PATH_INFO: `/` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:54.270515 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 353/693] 10.222.0.93 () {54 vars in 926 bytes} [Tue Jul 26 14:38:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 14:38:54.283582 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a8ba7f-6527-4efa-83bc-79d25a9e7303 None None] REQUEST_METHOD: `POST` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:54.284231 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a8ba7f-6527-4efa-83bc-79d25a9e7303 None None] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:54.284713 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a8ba7f-6527-4efa-83bc-79d25a9e7303 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:54.316741 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.auth.core [None req-12a8ba7f-6527-4efa-83bc-79d25a9e7303 None None] MFA Rules not processed for user `e5ef88cc058f425b882bcb87a1e1e75c`. Rule list: `[]` (Enabled: `True`). {{(pid=87056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:38:54.320845 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.fernet_utils [None req-12a8ba7f-6527-4efa-83bc-79d25a9e7303 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:38:54.427215 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2886aece-e18e-4cd8-b4e2-68807ac93705 None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:54.463455 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 354/694] 10.222.0.93 () {58 vars in 1023 bytes} [Tue Jul 26 14:38:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 14:38:54.489878 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8082f15b-5458-4b39-9835-efcf75067495 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:54.491511 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8082f15b-5458-4b39-9835-efcf75067495 None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:54.491990 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8082f15b-5458-4b39-9835-efcf75067495 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:54.492472 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8082f15b-5458-4b39-9835-efcf75067495 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:54.505960 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8082f15b-5458-4b39-9835-efcf75067495 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:38:54.508689 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a8ba7f-6527-4efa-83bc-79d25a9e7303 None None] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:54.509233 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8082f15b-5458-4b39-9835-efcf75067495 None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:38:54.543643 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application [None req-8082f15b-5458-4b39-9835-efcf75067495 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 14:38:54.543643 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:38:54.543643 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:38:54.543643 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:38:54.543643 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:38:54.543643 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:38:54.543643 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:38:54.543643 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:38:54.543643 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:38:54.543643 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:38:54.543643 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:38:54.543643 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:38:54.543643 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 14:38:54.543643 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 14:38:54.543643 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 14:38:54.545298 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 14:38:54.545298 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:38:54.545298 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:38:54.545298 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:38:54.545298 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:38:54.545298 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:38:54.545298 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:38:54.545298 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:38:54.545298 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application with Lock( Jul 26 14:38:54.545298 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:38:54.545298 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:38:54.545298 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:38:54.545298 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:38:54.545298 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:38:54.545298 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:38:54.545298 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:38:54.545298 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:38:54.547068 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 14:38:54.547068 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 14:38:54.547068 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 14:38:54.547068 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 14:38:54.547068 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 14:38:54.547068 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 14:38:54.547068 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 14:38:54.547068 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Jul 26 14:38:54.547068 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 341/695] 10.222.0.93 () {56 vars in 1111 bytes} [Tue Jul 26 14:38:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 14:38:54.557782 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8082f15b-5458-4b39-9835-efcf75067495 None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:54.670890 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:38:54.712877 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:38:54.775521 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8082f15b-5458-4b39-9835-efcf75067495 None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:54.782015 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a8ba7f-6527-4efa-83bc-79d25a9e7303 None None] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:54.836637 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9f4f69-63e2-47f1-b7c3-1e6fd99c1733 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:54.837657 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9f4f69-63e2-47f1-b7c3-1e6fd99c1733 None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:54.838139 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9f4f69-63e2-47f1-b7c3-1e6fd99c1733 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:54.838687 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9f4f69-63e2-47f1-b7c3-1e6fd99c1733 None admin] PATH_INFO: `/v3/projects` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:54.839682 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9f4f69-63e2-47f1-b7c3-1e6fd99c1733 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:38:54.840199 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9f4f69-63e2-47f1-b7c3-1e6fd99c1733 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:38:54.843241 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9f4f69-63e2-47f1-b7c3-1e6fd99c1733 None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:38:54.870305 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d617b789-df69-4907-b3d4-4d7bde56d06e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:54.872407 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d617b789-df69-4907-b3d4-4d7bde56d06e None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:54.873132 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d617b789-df69-4907-b3d4-4d7bde56d06e None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:54.874595 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d617b789-df69-4907-b3d4-4d7bde56d06e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:54.878089 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 342/696] 10.222.0.93 () {56 vars in 1148 bytes} [Tue Jul 26 14:38:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:38:54.885958 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9f4f69-63e2-47f1-b7c3-1e6fd99c1733 None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:54.904311 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d617b789-df69-4907-b3d4-4d7bde56d06e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 14:38:54.913520 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application [None req-d617b789-df69-4907-b3d4-4d7bde56d06e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 14:38:54.913520 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:38:54.913520 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:38:54.913520 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:38:54.913520 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:38:54.913520 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:38:54.913520 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:38:54.913520 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:38:54.913520 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:38:54.913520 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:38:54.913520 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:38:54.913520 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:38:54.913520 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 14:38:54.913520 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 14:38:54.913520 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 14:38:54.913520 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 14:38:54.914594 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 14:38:54.914594 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 14:38:54.914594 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 14:38:54.914594 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 14:38:54.914594 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:38:54.914594 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:38:54.914594 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:38:54.914594 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:38:54.914594 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:38:54.914594 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:38:54.914594 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:38:54.914594 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application with Lock( Jul 26 14:38:54.914594 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:38:54.914594 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:38:54.914594 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:38:54.914594 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:38:54.915426 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:38:54.915426 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:38:54.915426 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:38:54.915426 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:38:54.915426 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 14:38:54.915426 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 14:38:54.915426 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 14:38:54.915426 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 14:38:54.915426 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 14:38:54.915426 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 14:38:54.915426 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 14:38:54.915426 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Jul 26 14:38:54.918499 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 355/697] 10.222.0.93 () {56 vars in 1096 bytes} [Tue Jul 26 14:38:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 411 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 14:38:54.938030 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d617b789-df69-4907-b3d4-4d7bde56d06e None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:55.106401 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d617b789-df69-4907-b3d4-4d7bde56d06e None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:55.127786 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:38:55.162036 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa670ebc-cc7d-41fc-9d9c-ed98432c24dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:55.163515 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa670ebc-cc7d-41fc-9d9c-ed98432c24dc None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:55.165435 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa670ebc-cc7d-41fc-9d9c-ed98432c24dc None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:55.165976 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa670ebc-cc7d-41fc-9d9c-ed98432c24dc None admin] PATH_INFO: `/v3/roles` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:55.166986 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa670ebc-cc7d-41fc-9d9c-ed98432c24dc None admin] RBAC: Adding query filter params (name=admin) {{(pid=87056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:38:55.167830 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa670ebc-cc7d-41fc-9d9c-ed98432c24dc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:38:55.170398 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa670ebc-cc7d-41fc-9d9c-ed98432c24dc None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:38:55.196347 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 356/698] 10.222.0.93 () {56 vars in 1099 bytes} [Tue Jul 26 14:38:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:38:55.207289 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa670ebc-cc7d-41fc-9d9c-ed98432c24dc None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:55.244672 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9f4f69-63e2-47f1-b7c3-1e6fd99c1733 None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:55.343917 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:38:55.377753 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a028ab-6cf9-4dfe-84ed-0180050d03b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:55.378915 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a028ab-6cf9-4dfe-84ed-0180050d03b4 None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:55.379056 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a028ab-6cf9-4dfe-84ed-0180050d03b4 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:55.381116 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a028ab-6cf9-4dfe-84ed-0180050d03b4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:55.381116 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a028ab-6cf9-4dfe-84ed-0180050d03b4 None admin] RBAC: Adding query filter params (role.id=2e45ca312cda4bef9263725ae1c6dab7, scope.project.id=c422a2290a14424da20e2841cbc1741d, user.id=b914b2ba87e74def85f9694e1141e00b) {{(pid=87055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:38:55.382116 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a028ab-6cf9-4dfe-84ed-0180050d03b4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:38:55.384682 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a028ab-6cf9-4dfe-84ed-0180050d03b4 None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:38:55.419549 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 343/699] 10.222.0.93 () {56 vars in 1374 bytes} [Tue Jul 26 14:38:54 2022] GET /identity/v3/role_assignments?user.id=b914b2ba87e74def85f9694e1141e00b&scope.project.id=c422a2290a14424da20e2841cbc1741d&role.id=2e45ca312cda4bef9263725ae1c6dab7 => generated 608 bytes in 534 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:38:55.508837 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa670ebc-cc7d-41fc-9d9c-ed98432c24dc None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:55.540971 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151072c3-c13f-4c8b-ab93-60973e4b5d79 None None] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:55.543125 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151072c3-c13f-4c8b-ab93-60973e4b5d79 None None] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:55.543125 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151072c3-c13f-4c8b-ab93-60973e4b5d79 None None] PATH_INFO: `/` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:55.544914 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 344/700] 10.222.0.93 () {54 vars in 926 bytes} [Tue Jul 26 14:38:55 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:38:55.554569 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bace640-ee44-4a40-9c7a-0a58e340045b None None] REQUEST_METHOD: `POST` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:55.555156 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bace640-ee44-4a40-9c7a-0a58e340045b None None] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:55.556055 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bace640-ee44-4a40-9c7a-0a58e340045b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:55.587830 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a30b732-8620-4421-a861-74bc644a5a44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:55.588854 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a30b732-8620-4421-a861-74bc644a5a44 None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:55.589305 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a30b732-8620-4421-a861-74bc644a5a44 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:55.589751 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a30b732-8620-4421-a861-74bc644a5a44 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:55.609807 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a30b732-8620-4421-a861-74bc644a5a44 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:38:55.612206 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a30b732-8620-4421-a861-74bc644a5a44 None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:38:55.616717 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.auth.core [None req-8bace640-ee44-4a40-9c7a-0a58e340045b None None] MFA Rules not processed for user `e5ef88cc058f425b882bcb87a1e1e75c`. Rule list: `[]` (Enabled: `True`). {{(pid=87055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:38:55.626908 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.fernet_utils [None req-8bace640-ee44-4a40-9c7a-0a58e340045b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:38:55.639575 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application [None req-8a30b732-8620-4421-a861-74bc644a5a44 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:38:55.639575 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:38:55.639575 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:38:55.639575 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:38:55.639575 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:38:55.639575 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:38:55.639575 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:38:55.639575 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:38:55.639575 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:38:55.639575 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:38:55.639575 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:38:55.639575 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:38:55.639575 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 14:38:55.639575 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 14:38:55.639575 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 14:38:55.640667 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 14:38:55.640667 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:38:55.640667 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:38:55.640667 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:38:55.640667 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:38:55.640667 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:38:55.640667 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:38:55.640667 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:38:55.640667 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application with Lock( Jul 26 14:38:55.640667 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:38:55.640667 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:38:55.640667 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:38:55.640667 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:38:55.640667 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:38:55.640667 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:38:55.640667 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:38:55.640667 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:38:55.641577 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 14:38:55.641577 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 14:38:55.641577 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:38:55.641577 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Jul 26 14:38:55.642082 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 357/701] 10.222.0.93 () {56 vars in 1108 bytes} [Tue Jul 26 14:38:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 436 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 14:38:55.660428 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a30b732-8620-4421-a861-74bc644a5a44 None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:55.770410 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:38:55.820885 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 345/702] 10.222.0.93 () {58 vars in 1023 bytes} [Tue Jul 26 14:38:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 14:38:55.859426 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bace640-ee44-4a40-9c7a-0a58e340045b None None] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:55.941634 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a30b732-8620-4421-a861-74bc644a5a44 None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:56.027761 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3139c6ad-fec0-4546-9150-75a2f34d3da8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:56.028842 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3139c6ad-fec0-4546-9150-75a2f34d3da8 None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:56.029345 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3139c6ad-fec0-4546-9150-75a2f34d3da8 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:56.030133 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3139c6ad-fec0-4546-9150-75a2f34d3da8 None admin] PATH_INFO: `/v3/domains` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:56.031286 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3139c6ad-fec0-4546-9150-75a2f34d3da8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:38:56.033331 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3139c6ad-fec0-4546-9150-75a2f34d3da8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:38:56.034736 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3139c6ad-fec0-4546-9150-75a2f34d3da8 None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:38:56.064648 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 358/703] 10.222.0.93 () {56 vars in 1109 bytes} [Tue Jul 26 14:38:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 405 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:38:56.074271 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3139c6ad-fec0-4546-9150-75a2f34d3da8 None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:56.097316 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bace640-ee44-4a40-9c7a-0a58e340045b None None] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:56.127720 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:38:56.171018 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4df40d0-55bf-419c-95d7-4be9910539cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:56.172481 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4df40d0-55bf-419c-95d7-4be9910539cf None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:56.173178 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4df40d0-55bf-419c-95d7-4be9910539cf None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:56.173807 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4df40d0-55bf-419c-95d7-4be9910539cf None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:56.175174 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4df40d0-55bf-419c-95d7-4be9910539cf None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:38:56.178274 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4df40d0-55bf-419c-95d7-4be9910539cf None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:38:56.209810 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application [None req-b4df40d0-55bf-419c-95d7-4be9910539cf None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 26 14:38:56.209810 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:38:56.209810 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 14:38:56.209810 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 14:38:56.209810 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 14:38:56.209810 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 14:38:56.209810 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 14:38:56.209810 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 14:38:56.209810 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 26 14:38:56.209810 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Jul 26 14:38:56.209810 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 14:38:56.209810 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Jul 26 14:38:56.209810 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:38:56.209810 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:38:56.209810 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:38:56.209810 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:38:56.211433 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:38:56.211433 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:38:56.211433 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:38:56.211433 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:38:56.211433 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:38:56.211433 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:38:56.211433 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:38:56.211433 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 14:38:56.211433 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 14:38:56.211433 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 14:38:56.211433 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 14:38:56.211433 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:38:56.211433 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:38:56.211433 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:38:56.211433 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:38:56.211433 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:38:56.212648 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:38:56.212648 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:38:56.212648 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application with Lock( Jul 26 14:38:56.212648 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:38:56.212648 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:38:56.212648 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:38:56.212648 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:38:56.212648 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:38:56.212648 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:38:56.212648 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:38:56.212648 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:38:56.212648 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 14:38:56.212648 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 14:38:56.212648 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 26 14:38:56.212648 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Jul 26 14:38:56.216348 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 346/704] 10.222.0.93 () {56 vars in 1129 bytes} [Tue Jul 26 14:38:55 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 358 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:38:56.226746 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4df40d0-55bf-419c-95d7-4be9910539cf None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:56.298766 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:38:56.328441 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3139c6ad-fec0-4546-9150-75a2f34d3da8 None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:56.403987 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042301ca-c0dc-4784-8df2-77f897e69967 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:56.405032 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042301ca-c0dc-4784-8df2-77f897e69967 None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:56.412443 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042301ca-c0dc-4784-8df2-77f897e69967 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:56.412443 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042301ca-c0dc-4784-8df2-77f897e69967 None admin] PATH_INFO: `/v3/users/nova` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:56.435244 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042301ca-c0dc-4784-8df2-77f897e69967 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:38:56.437853 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042301ca-c0dc-4784-8df2-77f897e69967 None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:38:56.464914 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application [None req-042301ca-c0dc-4784-8df2-77f897e69967 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 26 14:38:56.464914 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:38:56.464914 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:38:56.464914 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:38:56.464914 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:38:56.464914 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:38:56.464914 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:38:56.464914 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:38:56.464914 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:38:56.464914 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:38:56.464914 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:38:56.464914 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:38:56.464914 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 14:38:56.464914 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 14:38:56.464914 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 14:38:56.464914 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 14:38:56.465924 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:38:56.465924 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:38:56.465924 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 14:38:56.465924 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 14:38:56.465924 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 14:38:56.465924 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 14:38:56.465924 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:38:56.465924 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:38:56.465924 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:38:56.465924 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:38:56.465924 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:38:56.465924 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application with Lock( Jul 26 14:38:56.465924 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:38:56.465924 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:38:56.465924 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:38:56.465924 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:38:56.465924 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:38:56.465924 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:38:56.466874 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:38:56.466874 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:38:56.466874 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 14:38:56.466874 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 14:38:56.466874 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 14:38:56.466874 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 14:38:56.466874 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 14:38:56.466874 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 14:38:56.466874 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 26 14:38:56.466874 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Jul 26 14:38:56.475850 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 359/705] 10.222.0.93 () {56 vars in 1093 bytes} [Tue Jul 26 14:38:56 2022] GET /identity/v3/users/nova => generated 82 bytes in 403 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:38:56.482998 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042301ca-c0dc-4784-8df2-77f897e69967 None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:56.576303 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4df40d0-55bf-419c-95d7-4be9910539cf None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:56.666202 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00c9cac-bec0-4f03-94fb-106a314760ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:56.669869 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00c9cac-bec0-4f03-94fb-106a314760ad None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:56.670398 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00c9cac-bec0-4f03-94fb-106a314760ad None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:56.670894 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00c9cac-bec0-4f03-94fb-106a314760ad None admin] PATH_INFO: `/v3/services` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:56.672213 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00c9cac-bec0-4f03-94fb-106a314760ad None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=87055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:38:56.672765 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00c9cac-bec0-4f03-94fb-106a314760ad None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:38:56.679650 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00c9cac-bec0-4f03-94fb-106a314760ad None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:38:56.706445 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 347/706] 10.222.0.93 () {56 vars in 1124 bytes} [Tue Jul 26 14:38:56 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 481 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:38:56.728836 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00c9cac-bec0-4f03-94fb-106a314760ad None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:56.826881 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:38:56.850543 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042301ca-c0dc-4784-8df2-77f897e69967 None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:56.939918 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00c9cac-bec0-4f03-94fb-106a314760ad None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:56.996591 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9710871b-3c02-41d2-89e5-c6063e7ed4c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:56.997499 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9710871b-3c02-41d2-89e5-c6063e7ed4c5 None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:56.997953 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9710871b-3c02-41d2-89e5-c6063e7ed4c5 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:56.998431 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9710871b-3c02-41d2-89e5-c6063e7ed4c5 None admin] PATH_INFO: `/v3/users` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:56.999848 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9710871b-3c02-41d2-89e5-c6063e7ed4c5 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:38:57.000364 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9710871b-3c02-41d2-89e5-c6063e7ed4c5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:38:57.003036 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9710871b-3c02-41d2-89e5-c6063e7ed4c5 None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:38:57.008925 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dc4e2a-a1ba-49d9-805b-558ac681b111 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:57.009977 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dc4e2a-a1ba-49d9-805b-558ac681b111 None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:57.010503 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dc4e2a-a1ba-49d9-805b-558ac681b111 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:57.010994 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dc4e2a-a1ba-49d9-805b-558ac681b111 None admin] PATH_INFO: `/v3/services` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:57.012280 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20dc4e2a-a1ba-49d9-805b-558ac681b111 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=87055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:38:57.012831 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20dc4e2a-a1ba-49d9-805b-558ac681b111 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:38:57.015568 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20dc4e2a-a1ba-49d9-805b-558ac681b111 None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:38:57.027326 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 348/707] 10.222.0.93 () {56 vars in 1124 bytes} [Tue Jul 26 14:38:56 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:38:57.050427 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 360/708] 10.222.0.93 () {56 vars in 1133 bytes} [Tue Jul 26 14:38:56 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 569 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:38:57.060164 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dc4e2a-a1ba-49d9-805b-558ac681b111 None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:57.331144 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dc4e2a-a1ba-49d9-805b-558ac681b111 None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:57.355679 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:38:57.409837 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d4366a-30dc-4d6e-8e19-48e3e4792bec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:57.410983 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d4366a-30dc-4d6e-8e19-48e3e4792bec None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:57.411489 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d4366a-30dc-4d6e-8e19-48e3e4792bec None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:57.412045 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d4366a-30dc-4d6e-8e19-48e3e4792bec None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:57.555966 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d4366a-30dc-4d6e-8e19-48e3e4792bec None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:38:57.558708 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d4366a-30dc-4d6e-8e19-48e3e4792bec None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:38:57.668559 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49bdc1d-5d7e-4cf0-82cb-bcd0e2fbd1a1 None None] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:57.669237 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49bdc1d-5d7e-4cf0-82cb-bcd0e2fbd1a1 None None] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:57.669746 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49bdc1d-5d7e-4cf0-82cb-bcd0e2fbd1a1 None None] PATH_INFO: `/` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:57.675853 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 361/709] 10.222.0.93 () {54 vars in 926 bytes} [Tue Jul 26 14:38:57 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:38:57.681771 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f6dfa8-f4a6-47bf-9cb0-2e89104f6254 None None] REQUEST_METHOD: `POST` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:57.682436 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f6dfa8-f4a6-47bf-9cb0-2e89104f6254 None None] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:57.682940 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f6dfa8-f4a6-47bf-9cb0-2e89104f6254 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:57.731490 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.auth.core [None req-e8f6dfa8-f4a6-47bf-9cb0-2e89104f6254 None None] MFA Rules not processed for user `e5ef88cc058f425b882bcb87a1e1e75c`. Rule list: `[]` (Enabled: `True`). {{(pid=87056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:38:57.733097 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.fernet_utils [None req-e8f6dfa8-f4a6-47bf-9cb0-2e89104f6254 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:38:57.735666 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:38:57.765631 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 349/710] 10.222.0.93 () {58 vars in 1282 bytes} [Tue Jul 26 14:38:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 706 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 14:38:57.776210 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d4366a-30dc-4d6e-8e19-48e3e4792bec None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:57.823928 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:38:57.977815 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 362/711] 10.222.0.93 () {58 vars in 1023 bytes} [Tue Jul 26 14:38:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 14:38:58.018737 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f6dfa8-f4a6-47bf-9cb0-2e89104f6254 None None] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:58.072174 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d4366a-30dc-4d6e-8e19-48e3e4792bec None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:58.115556 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f447bac-a67a-47e5-8963-d8d1819e09fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:58.116625 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f447bac-a67a-47e5-8963-d8d1819e09fd None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:58.117080 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f447bac-a67a-47e5-8963-d8d1819e09fd None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:58.117522 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f447bac-a67a-47e5-8963-d8d1819e09fd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:58.129832 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f447bac-a67a-47e5-8963-d8d1819e09fd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:38:58.132508 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f447bac-a67a-47e5-8963-d8d1819e09fd None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:38:58.151853 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application [None req-0f447bac-a67a-47e5-8963-d8d1819e09fd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:38:58.151853 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:38:58.151853 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:38:58.151853 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:38:58.151853 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:38:58.151853 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:38:58.151853 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:38:58.151853 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:38:58.151853 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:38:58.151853 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:38:58.151853 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:38:58.151853 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:38:58.151853 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 14:38:58.151853 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 14:38:58.151853 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 14:38:58.153006 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 14:38:58.153006 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:38:58.153006 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:38:58.153006 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:38:58.153006 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:38:58.153006 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:38:58.153006 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:38:58.153006 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:38:58.153006 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application with Lock( Jul 26 14:38:58.153006 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:38:58.153006 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:38:58.153006 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:38:58.153006 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:38:58.153006 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:38:58.153006 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:38:58.153006 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:38:58.153006 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:38:58.153985 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 14:38:58.153985 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 14:38:58.153985 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:38:58.153985 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Jul 26 14:38:58.155974 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 350/712] 10.222.0.93 () {56 vars in 1108 bytes} [Tue Jul 26 14:38:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 381 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:38:58.157792 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629b470a-3ec4-4041-bd7a-90068a62fabb None None] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:58.158273 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629b470a-3ec4-4041-bd7a-90068a62fabb None None] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:58.158705 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629b470a-3ec4-4041-bd7a-90068a62fabb None None] PATH_INFO: `/` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:58.164689 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 351/713] 10.222.0.93 () {54 vars in 926 bytes} [Tue Jul 26 14:38:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:38:58.165942 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629b470a-3ec4-4041-bd7a-90068a62fabb None None] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:58.187836 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f6dfa8-f4a6-47bf-9cb0-2e89104f6254 None None] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:58.244957 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592c3d7a-eb74-4fd3-a9a7-c4c445e3c44a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:58.246202 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592c3d7a-eb74-4fd3-a9a7-c4c445e3c44a None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:58.246202 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592c3d7a-eb74-4fd3-a9a7-c4c445e3c44a None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:58.246491 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592c3d7a-eb74-4fd3-a9a7-c4c445e3c44a None admin] PATH_INFO: `/v3/roles/service` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:58.251048 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:38:58.268250 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:38:58.278207 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592c3d7a-eb74-4fd3-a9a7-c4c445e3c44a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 14:38:58.284142 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application [None req-592c3d7a-eb74-4fd3-a9a7-c4c445e3c44a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 26 14:38:58.284142 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:38:58.284142 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:38:58.284142 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:38:58.284142 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:38:58.284142 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:38:58.284142 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:38:58.284142 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:38:58.284142 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:38:58.284142 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:38:58.284142 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:38:58.284142 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:38:58.284142 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 14:38:58.284142 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 14:38:58.284142 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 14:38:58.284142 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 14:38:58.285181 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 14:38:58.285181 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 14:38:58.285181 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 14:38:58.285181 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 14:38:58.285181 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:38:58.285181 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:38:58.285181 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:38:58.285181 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:38:58.285181 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:38:58.285181 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:38:58.285181 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:38:58.285181 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application with Lock( Jul 26 14:38:58.285181 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:38:58.285181 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:38:58.285181 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:38:58.285181 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:38:58.286680 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:38:58.286680 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:38:58.286680 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:38:58.286680 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:38:58.286680 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 14:38:58.286680 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 14:38:58.286680 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 14:38:58.286680 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 14:38:58.286680 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 14:38:58.286680 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 14:38:58.286680 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 26 14:38:58.286680 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Jul 26 14:38:58.295428 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 363/714] 10.222.0.93 () {56 vars in 1102 bytes} [Tue Jul 26 14:38:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 14:38:58.299082 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a39bfae-b95b-40af-8edb-733c06de84b9 None None] REQUEST_METHOD: `POST` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:58.299710 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a39bfae-b95b-40af-8edb-733c06de84b9 None None] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:58.300191 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a39bfae-b95b-40af-8edb-733c06de84b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:58.321057 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629b470a-3ec4-4041-bd7a-90068a62fabb None None] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:58.323335 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.auth.core [None req-1a39bfae-b95b-40af-8edb-733c06de84b9 None None] MFA Rules not processed for user `e5ef88cc058f425b882bcb87a1e1e75c`. Rule list: `[]` (Enabled: `True`). {{(pid=87056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:38:58.325217 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.fernet_utils [None req-1a39bfae-b95b-40af-8edb-733c06de84b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:38:58.374061 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cfdd01-355a-4c76-82d7-d23e0110f249 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:58.374802 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cfdd01-355a-4c76-82d7-d23e0110f249 None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:58.375091 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cfdd01-355a-4c76-82d7-d23e0110f249 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:58.375376 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cfdd01-355a-4c76-82d7-d23e0110f249 None admin] PATH_INFO: `/v3/domains` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:58.376155 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cfdd01-355a-4c76-82d7-d23e0110f249 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:38:58.376512 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cfdd01-355a-4c76-82d7-d23e0110f249 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:38:58.377999 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cfdd01-355a-4c76-82d7-d23e0110f249 None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:38:58.398346 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 352/715] 10.222.0.93 () {56 vars in 1109 bytes} [Tue Jul 26 14:38:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:38:58.399634 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cfdd01-355a-4c76-82d7-d23e0110f249 None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:58.429362 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 364/716] 10.222.0.93 () {58 vars in 1023 bytes} [Tue Jul 26 14:38:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 14:38:58.429362 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a39bfae-b95b-40af-8edb-733c06de84b9 None None] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:58.558158 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cfdd01-355a-4c76-82d7-d23e0110f249 None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:58.572942 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a39bfae-b95b-40af-8edb-733c06de84b9 None None] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:58.602449 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:38:58.608084 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:38:58.622590 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59926fd-258e-4458-87ef-d2d85cee6b97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:58.623377 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68eafa0-53b7-4dd8-8e8d-b9fd674ca1ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:58.623884 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59926fd-258e-4458-87ef-d2d85cee6b97 None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:58.624374 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59926fd-258e-4458-87ef-d2d85cee6b97 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:58.624501 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68eafa0-53b7-4dd8-8e8d-b9fd674ca1ca None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:58.624981 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59926fd-258e-4458-87ef-d2d85cee6b97 None admin] PATH_INFO: `/v3/roles` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:58.625091 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68eafa0-53b7-4dd8-8e8d-b9fd674ca1ca None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:58.625545 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68eafa0-53b7-4dd8-8e8d-b9fd674ca1ca None admin] PATH_INFO: `/v3/projects/service` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:58.626336 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59926fd-258e-4458-87ef-d2d85cee6b97 None admin] RBAC: Adding query filter params (name=service) {{(pid=87055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:38:58.627058 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59926fd-258e-4458-87ef-d2d85cee6b97 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:38:58.628672 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59926fd-258e-4458-87ef-d2d85cee6b97 None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:38:58.644282 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68eafa0-53b7-4dd8-8e8d-b9fd674ca1ca None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:38:58.644282 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68eafa0-53b7-4dd8-8e8d-b9fd674ca1ca None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:38:58.645326 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 353/717] 10.222.0.93 () {56 vars in 1103 bytes} [Tue Jul 26 14:38:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:38:58.647131 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59926fd-258e-4458-87ef-d2d85cee6b97 None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:58.671354 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application [None req-a68eafa0-53b7-4dd8-8e8d-b9fd674ca1ca None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 14:38:58.671354 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:38:58.671354 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:38:58.671354 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:38:58.671354 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:38:58.671354 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:38:58.671354 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:38:58.671354 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:38:58.671354 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:38:58.671354 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:38:58.671354 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:38:58.671354 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:38:58.671354 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 14:38:58.671354 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 14:38:58.671354 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 14:38:58.672403 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 14:38:58.672403 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:38:58.672403 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:38:58.672403 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:38:58.672403 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:38:58.672403 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:38:58.672403 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:38:58.672403 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:38:58.672403 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application with Lock( Jul 26 14:38:58.672403 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:38:58.672403 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:38:58.672403 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:38:58.672403 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:38:58.672403 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:38:58.672403 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:38:58.672403 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:38:58.672403 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:38:58.673322 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 14:38:58.673322 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 14:38:58.673322 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 14:38:58.673322 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 14:38:58.673322 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 14:38:58.673322 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 14:38:58.673322 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 14:38:58.673322 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Jul 26 14:38:58.675981 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 365/718] 10.222.0.93 () {56 vars in 1111 bytes} [Tue Jul 26 14:38:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:38:58.677866 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68eafa0-53b7-4dd8-8e8d-b9fd674ca1ca None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:58.850393 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68eafa0-53b7-4dd8-8e8d-b9fd674ca1ca None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:58.850722 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59926fd-258e-4458-87ef-d2d85cee6b97 None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:58.897513 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5cffd9-f2ee-427f-b6e6-f3161f707254 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:58.898628 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5cffd9-f2ee-427f-b6e6-f3161f707254 None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:58.899143 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5cffd9-f2ee-427f-b6e6-f3161f707254 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:58.899694 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5cffd9-f2ee-427f-b6e6-f3161f707254 None admin] PATH_INFO: `/v3/services/network` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:58.900600 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5cffd9-f2ee-427f-b6e6-f3161f707254 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:38:58.902320 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5cffd9-f2ee-427f-b6e6-f3161f707254 None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:38:58.915064 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application [None req-cd5cffd9-f2ee-427f-b6e6-f3161f707254 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 26 14:38:58.915064 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:38:58.915064 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 14:38:58.915064 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 14:38:58.915064 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 14:38:58.915064 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 14:38:58.915064 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 14:38:58.915064 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 14:38:58.915064 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 26 14:38:58.915064 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Jul 26 14:38:58.915064 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 14:38:58.915064 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Jul 26 14:38:58.915064 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:38:58.915064 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:38:58.915064 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:38:58.915064 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:38:58.915064 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:38:58.916166 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:38:58.916166 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:38:58.916166 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:38:58.916166 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:38:58.916166 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:38:58.916166 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:38:58.916166 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 14:38:58.916166 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 14:38:58.916166 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 14:38:58.916166 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 14:38:58.916166 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:38:58.916166 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:38:58.916166 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:38:58.916166 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:38:58.916166 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:38:58.916166 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:38:58.917033 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:38:58.917033 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application with Lock( Jul 26 14:38:58.917033 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:38:58.917033 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:38:58.917033 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:38:58.917033 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:38:58.917033 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:38:58.917033 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:38:58.917033 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:38:58.917033 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:38:58.917033 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 14:38:58.917033 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 14:38:58.917033 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 26 14:38:58.917033 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Jul 26 14:38:58.925174 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 354/719] 10.222.0.93 () {56 vars in 1111 bytes} [Tue Jul 26 14:38:58 2022] GET /identity/v3/services/network => generated 88 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:38:58.926555 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5cffd9-f2ee-427f-b6e6-f3161f707254 None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:58.929085 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cb918f-8cb8-4784-9558-7f549ebf41de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:58.930112 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cb918f-8cb8-4784-9558-7f549ebf41de None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:58.930578 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cb918f-8cb8-4784-9558-7f549ebf41de None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:58.931533 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cb918f-8cb8-4784-9558-7f549ebf41de None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:58.959522 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cb918f-8cb8-4784-9558-7f549ebf41de None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:38:58.962989 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cb918f-8cb8-4784-9558-7f549ebf41de None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:38:58.981423 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application [None req-88cb918f-8cb8-4784-9558-7f549ebf41de None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:38:58.981423 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:38:58.981423 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:38:58.981423 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:38:58.981423 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:38:58.981423 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:38:58.981423 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:38:58.981423 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:38:58.981423 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:38:58.981423 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:38:58.981423 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:38:58.981423 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:38:58.981423 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 14:38:58.981423 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 14:38:58.981423 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 14:38:58.982863 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 14:38:58.982863 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:38:58.982863 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:38:58.982863 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:38:58.982863 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:38:58.982863 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:38:58.982863 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:38:58.982863 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:38:58.982863 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application with Lock( Jul 26 14:38:58.982863 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:38:58.982863 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:38:58.982863 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:38:58.982863 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:38:58.982863 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:38:58.982863 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:38:58.982863 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:38:58.982863 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:38:58.983818 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 14:38:58.983818 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 14:38:58.983818 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:38:58.983818 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Jul 26 14:38:58.991583 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 366/720] 10.222.0.93 () {56 vars in 1108 bytes} [Tue Jul 26 14:38:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:38:58.992983 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cb918f-8cb8-4784-9558-7f549ebf41de None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:59.030908 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:38:59.068806 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:38:59.095351 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5cffd9-f2ee-427f-b6e6-f3161f707254 None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:59.164103 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d296d1ec-e4c2-48c3-9a51-e6a95e322e3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:59.165073 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d296d1ec-e4c2-48c3-9a51-e6a95e322e3c None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:59.165539 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d296d1ec-e4c2-48c3-9a51-e6a95e322e3c None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:59.166056 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d296d1ec-e4c2-48c3-9a51-e6a95e322e3c None admin] PATH_INFO: `/v3/projects` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:59.168902 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d296d1ec-e4c2-48c3-9a51-e6a95e322e3c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:38:59.169563 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d296d1ec-e4c2-48c3-9a51-e6a95e322e3c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:38:59.173706 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d296d1ec-e4c2-48c3-9a51-e6a95e322e3c None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:38:59.191490 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 355/721] 10.222.0.93 () {56 vars in 1148 bytes} [Tue Jul 26 14:38:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:38:59.191704 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cb918f-8cb8-4784-9558-7f549ebf41de None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:59.192976 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d296d1ec-e4c2-48c3-9a51-e6a95e322e3c None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:59.251387 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d893df-84da-4db0-ab71-e175ddb529b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:59.252373 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d893df-84da-4db0-ab71-e175ddb529b5 None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:59.252849 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d893df-84da-4db0-ab71-e175ddb529b5 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:59.253316 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d893df-84da-4db0-ab71-e175ddb529b5 None admin] PATH_INFO: `/v3/services` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:59.254562 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d893df-84da-4db0-ab71-e175ddb529b5 None admin] RBAC: Adding query filter params (name=network) {{(pid=87056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:38:59.255075 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d893df-84da-4db0-ab71-e175ddb529b5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:38:59.257470 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d893df-84da-4db0-ab71-e175ddb529b5 None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:38:59.265190 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 367/722] 10.222.0.93 () {56 vars in 1112 bytes} [Tue Jul 26 14:38:58 2022] GET /identity/v3/services?name=network => generated 124 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:38:59.266655 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d893df-84da-4db0-ab71-e175ddb529b5 None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:59.343704 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d296d1ec-e4c2-48c3-9a51-e6a95e322e3c None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:59.361489 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:38:59.395016 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059a15f0-6140-4d5a-8753-bad278de362c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:59.396039 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059a15f0-6140-4d5a-8753-bad278de362c None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:59.396578 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059a15f0-6140-4d5a-8753-bad278de362c None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:59.397033 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059a15f0-6140-4d5a-8753-bad278de362c None admin] PATH_INFO: `/v3/domains` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:59.398033 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059a15f0-6140-4d5a-8753-bad278de362c None admin] RBAC: Adding query filter params (name=Default) {{(pid=87055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:38:59.398567 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059a15f0-6140-4d5a-8753-bad278de362c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:38:59.401421 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059a15f0-6140-4d5a-8753-bad278de362c None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:38:59.428975 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 356/723] 10.222.0.93 () {56 vars in 1109 bytes} [Tue Jul 26 14:38:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:38:59.428975 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa666a21-97c3-451a-a186-da5d281e3d43 None None] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:59.428975 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa666a21-97c3-451a-a186-da5d281e3d43 None None] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:59.428975 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa666a21-97c3-451a-a186-da5d281e3d43 None None] PATH_INFO: `/` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:59.428975 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 357/724] 10.222.0.93 () {54 vars in 926 bytes} [Tue Jul 26 14:38:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:38:59.430127 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa666a21-97c3-451a-a186-da5d281e3d43 None None] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:59.452297 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d893df-84da-4db0-ab71-e175ddb529b5 None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:59.457485 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:38:59.506064 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d51da8-e7d9-4ba3-9315-8a3603d6ada5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:59.507097 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d51da8-e7d9-4ba3-9315-8a3603d6ada5 None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:59.507556 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d51da8-e7d9-4ba3-9315-8a3603d6ada5 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:59.508010 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d51da8-e7d9-4ba3-9315-8a3603d6ada5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:59.509414 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d51da8-e7d9-4ba3-9315-8a3603d6ada5 None admin] RBAC: Adding query filter params (role.id=94e105ff8ee4486abd501415cc05ba38, scope.project.id=c422a2290a14424da20e2841cbc1741d, user.id=2e86fe36c9bf49a481c9f15ac7571b88) {{(pid=87056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:38:59.509931 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d51da8-e7d9-4ba3-9315-8a3603d6ada5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:38:59.512461 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d51da8-e7d9-4ba3-9315-8a3603d6ada5 None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:38:59.530284 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 368/725] 10.222.0.93 () {56 vars in 1374 bytes} [Tue Jul 26 14:38:59 2022] GET /identity/v3/role_assignments?user.id=2e86fe36c9bf49a481c9f15ac7571b88&scope.project.id=c422a2290a14424da20e2841cbc1741d&role.id=94e105ff8ee4486abd501415cc05ba38 => generated 259 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:38:59.530284 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d51da8-e7d9-4ba3-9315-8a3603d6ada5 None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:59.618591 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa666a21-97c3-451a-a186-da5d281e3d43 None None] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:59.703426 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba79665d-55ae-4b42-9e7a-2a237352c767 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:59.704696 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba79665d-55ae-4b42-9e7a-2a237352c767 None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:59.705327 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba79665d-55ae-4b42-9e7a-2a237352c767 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:59.705857 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba79665d-55ae-4b42-9e7a-2a237352c767 None admin] PATH_INFO: `/v3/services` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:59.707137 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba79665d-55ae-4b42-9e7a-2a237352c767 None admin] RBAC: Adding query filter params (type=network) {{(pid=87055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:38:59.707697 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba79665d-55ae-4b42-9e7a-2a237352c767 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:38:59.709279 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d51da8-e7d9-4ba3-9315-8a3603d6ada5 None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:59.710432 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba79665d-55ae-4b42-9e7a-2a237352c767 None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:38:59.719914 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 358/726] 10.222.0.93 () {56 vars in 1112 bytes} [Tue Jul 26 14:38:59 2022] GET /identity/v3/services?type=network => generated 124 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:38:59.722617 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4807f112-535d-466f-a387-b440d0273217 None None] REQUEST_METHOD: `POST` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:59.723232 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4807f112-535d-466f-a387-b440d0273217 None None] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:59.723797 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4807f112-535d-466f-a387-b440d0273217 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:59.756665 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57033b1a-6b62-4245-beb2-1297e2aa27f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:59.757730 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57033b1a-6b62-4245-beb2-1297e2aa27f0 None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:59.758104 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.auth.core [None req-4807f112-535d-466f-a387-b440d0273217 None None] MFA Rules not processed for user `e5ef88cc058f425b882bcb87a1e1e75c`. Rule list: `[]` (Enabled: `True`). {{(pid=87055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:38:59.758397 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57033b1a-6b62-4245-beb2-1297e2aa27f0 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:59.758993 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57033b1a-6b62-4245-beb2-1297e2aa27f0 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:38:59.760537 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.fernet_utils [None req-4807f112-535d-466f-a387-b440d0273217 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:38:59.770202 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57033b1a-6b62-4245-beb2-1297e2aa27f0 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:38:59.772295 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57033b1a-6b62-4245-beb2-1297e2aa27f0 None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:38:59.786316 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application [None req-57033b1a-6b62-4245-beb2-1297e2aa27f0 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 26 14:38:59.786316 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:38:59.786316 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:38:59.786316 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:38:59.786316 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:38:59.786316 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:38:59.786316 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:38:59.786316 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:38:59.786316 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:38:59.786316 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:38:59.786316 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:38:59.786316 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:38:59.786316 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 14:38:59.786316 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 14:38:59.786316 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 14:38:59.786316 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 14:38:59.787906 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:38:59.787906 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:38:59.787906 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 14:38:59.787906 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 14:38:59.787906 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 14:38:59.787906 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 14:38:59.787906 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:38:59.787906 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:38:59.787906 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:38:59.787906 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:38:59.787906 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:38:59.787906 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application with Lock( Jul 26 14:38:59.787906 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:38:59.787906 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:38:59.787906 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:38:59.787906 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:38:59.787906 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:38:59.787906 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:38:59.788863 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:38:59.788863 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:38:59.788863 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 14:38:59.788863 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 14:38:59.788863 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 14:38:59.788863 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 14:38:59.788863 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 14:38:59.788863 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 14:38:59.788863 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 26 14:38:59.788863 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Jul 26 14:38:59.797002 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 369/727] 10.222.0.93 () {56 vars in 1117 bytes} [Tue Jul 26 14:38:59 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:38:59.798405 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57033b1a-6b62-4245-beb2-1297e2aa27f0 None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:38:59.836663 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:38:59.840362 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:38:59.946998 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57033b1a-6b62-4245-beb2-1297e2aa27f0 None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:38:59.951219 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 359/728] 10.222.0.93 () {58 vars in 1023 bytes} [Tue Jul 26 14:38:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 14:38:59.996436 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df0323a-80d5-4e05-97f2-8717e9420885 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:38:59.997854 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df0323a-80d5-4e05-97f2-8717e9420885 None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:38:59.998466 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df0323a-80d5-4e05-97f2-8717e9420885 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:38:59.998937 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df0323a-80d5-4e05-97f2-8717e9420885 None admin] PATH_INFO: `/v3/users` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:00.000005 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df0323a-80d5-4e05-97f2-8717e9420885 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=87056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:39:00.000535 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df0323a-80d5-4e05-97f2-8717e9420885 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:00.002355 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df0323a-80d5-4e05-97f2-8717e9420885 None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:00.007498 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4807f112-535d-466f-a387-b440d0273217 None None] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:00.025821 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 370/729] 10.222.0.93 () {56 vars in 1149 bytes} [Tue Jul 26 14:38:59 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:39:00.033368 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df0323a-80d5-4e05-97f2-8717e9420885 None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:00.212973 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:00.233700 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df0323a-80d5-4e05-97f2-8717e9420885 None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:00.282923 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1831c9a-9237-488d-aeba-82a12d1ea73a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:00.284009 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1831c9a-9237-488d-aeba-82a12d1ea73a None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:00.284558 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1831c9a-9237-488d-aeba-82a12d1ea73a None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:00.285036 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1831c9a-9237-488d-aeba-82a12d1ea73a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:00.298059 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4807f112-535d-466f-a387-b440d0273217 None None] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:00.377341 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1831c9a-9237-488d-aeba-82a12d1ea73a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:00.387643 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1831c9a-9237-488d-aeba-82a12d1ea73a None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:00.404174 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf252500-e8f5-4386-ad46-2a0a8bad6c68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:00.405418 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf252500-e8f5-4386-ad46-2a0a8bad6c68 None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:00.405841 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf252500-e8f5-4386-ad46-2a0a8bad6c68 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:00.406368 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf252500-e8f5-4386-ad46-2a0a8bad6c68 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:00.431456 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf252500-e8f5-4386-ad46-2a0a8bad6c68 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 14:39:00.437482 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application [None req-bf252500-e8f5-4386-ad46-2a0a8bad6c68 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 14:39:00.437482 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:39:00.437482 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:39:00.437482 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:39:00.437482 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:39:00.437482 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:39:00.437482 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:39:00.437482 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:39:00.437482 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:39:00.437482 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:39:00.437482 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:39:00.437482 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:39:00.437482 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 14:39:00.437482 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 14:39:00.437482 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 14:39:00.437482 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 14:39:00.445161 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 14:39:00.445161 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 14:39:00.445161 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 14:39:00.445161 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 14:39:00.445161 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:39:00.445161 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:39:00.445161 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:39:00.445161 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:39:00.445161 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:39:00.445161 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:39:00.445161 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:39:00.445161 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application with Lock( Jul 26 14:39:00.445161 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:39:00.445161 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:39:00.445161 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:39:00.445161 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:39:00.446017 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:39:00.446017 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:39:00.446017 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:39:00.446017 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:39:00.446017 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 14:39:00.446017 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 14:39:00.446017 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 14:39:00.446017 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 14:39:00.446017 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 14:39:00.446017 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 14:39:00.446017 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 14:39:00.446017 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Jul 26 14:39:00.446017 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 360/730] 10.222.0.93 () {56 vars in 1096 bytes} [Tue Jul 26 14:39:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 434 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 14:39:00.448845 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf252500-e8f5-4386-ad46-2a0a8bad6c68 None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:00.509902 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:00.535537 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:00.565651 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 371/731] 10.222.0.93 () {58 vars in 1282 bytes} [Tue Jul 26 14:39:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 533 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 26 14:39:00.572932 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1831c9a-9237-488d-aeba-82a12d1ea73a None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:00.797282 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf252500-e8f5-4386-ad46-2a0a8bad6c68 None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:00.852666 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ba3eb9-f326-4aba-aa4f-15c54410bfed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:00.853346 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ba3eb9-f326-4aba-aa4f-15c54410bfed None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:00.853606 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ba3eb9-f326-4aba-aa4f-15c54410bfed None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:00.853896 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ba3eb9-f326-4aba-aa4f-15c54410bfed None admin] PATH_INFO: `/v3/roles` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:00.854682 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ba3eb9-f326-4aba-aa4f-15c54410bfed None admin] RBAC: Adding query filter params (name=admin) {{(pid=87055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:39:00.854995 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ba3eb9-f326-4aba-aa4f-15c54410bfed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:00.856410 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ba3eb9-f326-4aba-aa4f-15c54410bfed None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:00.869195 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 361/732] 10.222.0.93 () {56 vars in 1099 bytes} [Tue Jul 26 14:39:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 421 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:39:00.871561 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6afd95a-ccde-45f2-bb70-437153164880 None None] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:00.871862 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6afd95a-ccde-45f2-bb70-437153164880 None None] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:00.872133 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6afd95a-ccde-45f2-bb70-437153164880 None None] PATH_INFO: `/` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:00.878047 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 362/733] 10.222.0.93 () {54 vars in 926 bytes} [Tue Jul 26 14:39:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:39:00.878047 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6afd95a-ccde-45f2-bb70-437153164880 None None] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:00.885190 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1831c9a-9237-488d-aeba-82a12d1ea73a None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:00.932294 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b3da93-65f8-4480-b8ba-5b2ca3715515 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:00.932946 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b3da93-65f8-4480-b8ba-5b2ca3715515 None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:00.933257 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b3da93-65f8-4480-b8ba-5b2ca3715515 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:00.933517 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b3da93-65f8-4480-b8ba-5b2ca3715515 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:00.949118 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b3da93-65f8-4480-b8ba-5b2ca3715515 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:00.950645 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b3da93-65f8-4480-b8ba-5b2ca3715515 None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:00.973127 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application [None req-68b3da93-65f8-4480-b8ba-5b2ca3715515 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:39:00.973127 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:39:00.973127 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:39:00.973127 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:39:00.973127 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:39:00.973127 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:39:00.973127 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:39:00.973127 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:39:00.973127 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:39:00.973127 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:39:00.973127 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:39:00.973127 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:39:00.973127 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 14:39:00.973127 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 14:39:00.973127 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 14:39:00.974998 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 14:39:00.974998 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:39:00.974998 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:39:00.974998 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:39:00.974998 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:39:00.974998 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:39:00.974998 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:39:00.974998 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:39:00.974998 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application with Lock( Jul 26 14:39:00.974998 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:39:00.974998 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:39:00.974998 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:39:00.974998 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:39:00.974998 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:39:00.974998 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:39:00.974998 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:39:00.974998 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:39:00.975918 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 14:39:00.975918 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 14:39:00.975918 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:39:00.975918 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Jul 26 14:39:00.979657 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 372/734] 10.222.0.93 () {56 vars in 1108 bytes} [Tue Jul 26 14:39:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 403 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 14:39:00.981046 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332c4a62-fd44-4d71-8f06-2364d0ab7bf6 None None] REQUEST_METHOD: `POST` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:00.982022 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332c4a62-fd44-4d71-8f06-2364d0ab7bf6 None None] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:00.982346 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332c4a62-fd44-4d71-8f06-2364d0ab7bf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:00.994524 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:01.008296 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.auth.core [None req-332c4a62-fd44-4d71-8f06-2364d0ab7bf6 None None] MFA Rules not processed for user `e5ef88cc058f425b882bcb87a1e1e75c`. Rule list: `[]` (Enabled: `True`). {{(pid=87056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:39:01.010692 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.fernet_utils [None req-332c4a62-fd44-4d71-8f06-2364d0ab7bf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:39:01.019487 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6afd95a-ccde-45f2-bb70-437153164880 None None] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:01.051934 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:01.062645 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacfad2a-4768-449f-8da4-d1eb51b678ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:01.063573 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacfad2a-4768-449f-8da4-d1eb51b678ed None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:01.064022 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacfad2a-4768-449f-8da4-d1eb51b678ed None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:01.064555 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacfad2a-4768-449f-8da4-d1eb51b678ed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:01.079185 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacfad2a-4768-449f-8da4-d1eb51b678ed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:01.081006 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacfad2a-4768-449f-8da4-d1eb51b678ed None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:01.098514 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application [None req-eacfad2a-4768-449f-8da4-d1eb51b678ed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:39:01.098514 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:39:01.098514 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:39:01.098514 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:39:01.098514 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:39:01.098514 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:39:01.098514 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:39:01.098514 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:39:01.098514 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:39:01.098514 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:39:01.098514 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:39:01.098514 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:39:01.098514 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 14:39:01.098514 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 14:39:01.098514 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 14:39:01.100041 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 14:39:01.100041 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:39:01.100041 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:39:01.100041 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:39:01.100041 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:39:01.100041 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:39:01.100041 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:39:01.100041 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:39:01.100041 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application with Lock( Jul 26 14:39:01.100041 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:39:01.100041 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:39:01.100041 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:39:01.100041 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:39:01.100041 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:39:01.100041 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:39:01.100041 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:39:01.100041 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:39:01.100923 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 14:39:01.100923 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 14:39:01.100923 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:39:01.100923 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Jul 26 14:39:01.101440 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 373/735] 10.222.0.93 () {58 vars in 1023 bytes} [Tue Jul 26 14:39:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 14:39:01.102511 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332c4a62-fd44-4d71-8f06-2364d0ab7bf6 None None] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:01.104483 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 363/736] 10.222.0.93 () {56 vars in 1108 bytes} [Tue Jul 26 14:39:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:39:01.110450 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacfad2a-4768-449f-8da4-d1eb51b678ed None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:01.233056 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332c4a62-fd44-4d71-8f06-2364d0ab7bf6 None None] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:01.252846 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacfad2a-4768-449f-8da4-d1eb51b678ed None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:01.278373 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e9cbfb-bde5-43eb-9815-52d09c54e670 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:01.279820 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e9cbfb-bde5-43eb-9815-52d09c54e670 None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:01.280429 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e9cbfb-bde5-43eb-9815-52d09c54e670 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:01.280961 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e9cbfb-bde5-43eb-9815-52d09c54e670 None admin] PATH_INFO: `/v3/domains` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:01.282101 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e9cbfb-bde5-43eb-9815-52d09c54e670 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:39:01.282739 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e9cbfb-bde5-43eb-9815-52d09c54e670 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:01.285045 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e9cbfb-bde5-43eb-9815-52d09c54e670 None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:01.300022 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d7bdff-514f-4b89-8a32-82b8e6f3eff0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:01.300806 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d7bdff-514f-4b89-8a32-82b8e6f3eff0 None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:01.301185 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d7bdff-514f-4b89-8a32-82b8e6f3eff0 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:01.301582 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d7bdff-514f-4b89-8a32-82b8e6f3eff0 None admin] PATH_INFO: `/v3/domains` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:01.303224 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d7bdff-514f-4b89-8a32-82b8e6f3eff0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:39:01.303844 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d7bdff-514f-4b89-8a32-82b8e6f3eff0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:01.308562 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d7bdff-514f-4b89-8a32-82b8e6f3eff0 None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:01.309122 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 374/737] 10.222.0.93 () {56 vars in 1109 bytes} [Tue Jul 26 14:39:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:39:01.309914 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:01.310433 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e9cbfb-bde5-43eb-9815-52d09c54e670 None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:01.322553 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 364/738] 10.222.0.93 () {56 vars in 1109 bytes} [Tue Jul 26 14:39:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:39:01.327435 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d7bdff-514f-4b89-8a32-82b8e6f3eff0 None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:01.352564 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:01.446842 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e9cbfb-bde5-43eb-9815-52d09c54e670 None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:01.465334 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d7bdff-514f-4b89-8a32-82b8e6f3eff0 None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:01.518004 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a5a987-7b33-4dee-8db0-6e4067d2c772 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:01.519347 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a5a987-7b33-4dee-8db0-6e4067d2c772 None admin] REQUEST_METHOD: `POST` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:01.519876 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a5a987-7b33-4dee-8db0-6e4067d2c772 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:01.520178 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b77b846-5aa1-4c1e-b476-10c4a1816200 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:01.520397 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a5a987-7b33-4dee-8db0-6e4067d2c772 None admin] PATH_INFO: `/v3/services` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:01.522198 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a5a987-7b33-4dee-8db0-6e4067d2c772 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:01.522431 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b77b846-5aa1-4c1e-b476-10c4a1816200 None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:01.522905 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b77b846-5aa1-4c1e-b476-10c4a1816200 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:01.526606 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a5a987-7b33-4dee-8db0-6e4067d2c772 None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:01.527027 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b77b846-5aa1-4c1e-b476-10c4a1816200 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:01.538766 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b77b846-5aa1-4c1e-b476-10c4a1816200 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:01.540453 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b77b846-5aa1-4c1e-b476-10c4a1816200 None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:01.557310 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application [None req-9b77b846-5aa1-4c1e-b476-10c4a1816200 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 14:39:01.557310 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:39:01.557310 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:39:01.557310 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:39:01.557310 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:39:01.557310 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:39:01.557310 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:39:01.557310 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:39:01.557310 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:39:01.557310 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:39:01.557310 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:39:01.557310 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:39:01.557310 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 14:39:01.557310 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 14:39:01.557310 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 14:39:01.559109 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 14:39:01.559109 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:39:01.559109 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:39:01.559109 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:39:01.559109 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:39:01.559109 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:39:01.559109 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:39:01.559109 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:39:01.559109 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application with Lock( Jul 26 14:39:01.559109 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:39:01.559109 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:39:01.559109 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:39:01.559109 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:39:01.559109 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:39:01.559109 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:39:01.559109 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:39:01.559109 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:39:01.560962 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 14:39:01.560962 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 14:39:01.560962 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 14:39:01.560962 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 14:39:01.560962 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 14:39:01.560962 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 14:39:01.560962 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 14:39:01.560962 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Jul 26 14:39:01.563521 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 365/739] 10.222.0.93 () {56 vars in 1111 bytes} [Tue Jul 26 14:39:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:39:01.564201 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b77b846-5aa1-4c1e-b476-10c4a1816200 None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:01.664734 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:01.684189 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 375/740] 10.222.0.93 () {60 vars in 1141 bytes} [Tue Jul 26 14:39:01 2022] POST /identity/v3/services => generated 251 bytes in 374 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 14:39:01.685148 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a5a987-7b33-4dee-8db0-6e4067d2c772 None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:01.785992 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b77b846-5aa1-4c1e-b476-10c4a1816200 None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:01.894283 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4868db75-2d0d-4e80-b9f4-b6c58e2aa1b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:01.895650 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4868db75-2d0d-4e80-b9f4-b6c58e2aa1b0 None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:01.896340 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4868db75-2d0d-4e80-b9f4-b6c58e2aa1b0 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:01.896340 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4868db75-2d0d-4e80-b9f4-b6c58e2aa1b0 None admin] PATH_INFO: `/v3/users/swift` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:01.913394 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4868db75-2d0d-4e80-b9f4-b6c58e2aa1b0 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:01.914671 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:01.917487 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4868db75-2d0d-4e80-b9f4-b6c58e2aa1b0 None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:01.946492 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a5a987-7b33-4dee-8db0-6e4067d2c772 None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:01.948225 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application [None req-4868db75-2d0d-4e80-b9f4-b6c58e2aa1b0 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 26 14:39:01.948225 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:39:01.948225 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:39:01.948225 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:39:01.948225 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:39:01.948225 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:39:01.948225 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:39:01.948225 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:39:01.948225 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:39:01.948225 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:39:01.948225 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:39:01.948225 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:39:01.948225 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 14:39:01.948225 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 14:39:01.948225 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 14:39:01.948225 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 14:39:01.949913 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:39:01.949913 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:39:01.949913 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 14:39:01.949913 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 14:39:01.949913 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 14:39:01.949913 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 14:39:01.949913 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:39:01.949913 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:39:01.949913 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:39:01.949913 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:39:01.949913 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:39:01.949913 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application with Lock( Jul 26 14:39:01.949913 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:39:01.949913 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:39:01.949913 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:39:01.949913 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:39:01.949913 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:39:01.949913 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:39:01.951761 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:39:01.951761 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:39:01.951761 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 14:39:01.951761 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 14:39:01.951761 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 14:39:01.951761 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 14:39:01.951761 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 14:39:01.951761 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 14:39:01.951761 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 26 14:39:01.951761 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Jul 26 14:39:01.951761 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 366/741] 10.222.0.93 () {56 vars in 1096 bytes} [Tue Jul 26 14:39:01 2022] GET /identity/v3/users/swift => generated 83 bytes in 386 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:39:01.958287 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4868db75-2d0d-4e80-b9f4-b6c58e2aa1b0 None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:02.038993 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5d9149-1619-41f5-b6a3-637925962fd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:02.040998 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5d9149-1619-41f5-b6a3-637925962fd9 None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:02.041519 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5d9149-1619-41f5-b6a3-637925962fd9 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:02.042021 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5d9149-1619-41f5-b6a3-637925962fd9 None admin] PATH_INFO: `/v3/projects` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:02.044798 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5d9149-1619-41f5-b6a3-637925962fd9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:39:02.045355 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5d9149-1619-41f5-b6a3-637925962fd9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:02.050225 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5d9149-1619-41f5-b6a3-637925962fd9 None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:02.086264 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 376/742] 10.222.0.93 () {56 vars in 1148 bytes} [Tue Jul 26 14:39:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 402 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:39:02.094099 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5d9149-1619-41f5-b6a3-637925962fd9 None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:02.138016 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4868db75-2d0d-4e80-b9f4-b6c58e2aa1b0 None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:02.163577 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:02.191937 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ea6042-016e-4d07-9c5e-3863e269a990 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:02.192617 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ea6042-016e-4d07-9c5e-3863e269a990 None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:02.194639 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ea6042-016e-4d07-9c5e-3863e269a990 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:02.194639 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ea6042-016e-4d07-9c5e-3863e269a990 None admin] PATH_INFO: `/v3/users` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:02.195009 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ea6042-016e-4d07-9c5e-3863e269a990 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=87055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:39:02.195188 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ea6042-016e-4d07-9c5e-3863e269a990 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:02.196717 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ea6042-016e-4d07-9c5e-3863e269a990 None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:02.218871 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 367/743] 10.222.0.93 () {56 vars in 1135 bytes} [Tue Jul 26 14:39:01 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:39:02.220175 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81c5236-0d4f-4d97-a060-9790e96cd9a8 None None] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:02.220470 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81c5236-0d4f-4d97-a060-9790e96cd9a8 None None] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:02.220866 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81c5236-0d4f-4d97-a060-9790e96cd9a8 None None] PATH_INFO: `/` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:02.225546 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 368/744] 10.222.0.93 () {54 vars in 926 bytes} [Tue Jul 26 14:39:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:39:02.228514 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81c5236-0d4f-4d97-a060-9790e96cd9a8 None None] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:02.280265 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5d9149-1619-41f5-b6a3-637925962fd9 None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:02.328048 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa90593-2c31-47d9-bc53-31697d57caf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:02.328697 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa90593-2c31-47d9-bc53-31697d57caf6 None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:02.328964 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa90593-2c31-47d9-bc53-31697d57caf6 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:02.329317 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa90593-2c31-47d9-bc53-31697d57caf6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:02.330193 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa90593-2c31-47d9-bc53-31697d57caf6 None admin] RBAC: Adding query filter params (role.id=2e45ca312cda4bef9263725ae1c6dab7, scope.project.id=c422a2290a14424da20e2841cbc1741d, user.id=0205dfcfb5e5404c95aefc1f45a1e1e6) {{(pid=87056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:39:02.330556 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa90593-2c31-47d9-bc53-31697d57caf6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:02.332109 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa90593-2c31-47d9-bc53-31697d57caf6 None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:02.346605 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 377/745] 10.222.0.93 () {56 vars in 1374 bytes} [Tue Jul 26 14:39:02 2022] GET /identity/v3/role_assignments?user.id=0205dfcfb5e5404c95aefc1f45a1e1e6&scope.project.id=c422a2290a14424da20e2841cbc1741d&role.id=2e45ca312cda4bef9263725ae1c6dab7 => generated 259 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:39:02.348186 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfc88d7-832f-4fc5-b6e8-008f102c08e1 None None] REQUEST_METHOD: `POST` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:02.348522 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfc88d7-832f-4fc5-b6e8-008f102c08e1 None None] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:02.348749 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfc88d7-832f-4fc5-b6e8-008f102c08e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:02.387019 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.auth.core [None req-edfc88d7-832f-4fc5-b6e8-008f102c08e1 None None] MFA Rules not processed for user `e5ef88cc058f425b882bcb87a1e1e75c`. Rule list: `[]` (Enabled: `True`). {{(pid=87056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:39:02.388295 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.fernet_utils [None req-edfc88d7-832f-4fc5-b6e8-008f102c08e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:39:02.408605 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:02.425023 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81c5236-0d4f-4d97-a060-9790e96cd9a8 None None] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:02.471270 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffa4c37-1eca-4ef8-8b23-d46d8abea93d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:02.471929 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffa4c37-1eca-4ef8-8b23-d46d8abea93d None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:02.472199 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffa4c37-1eca-4ef8-8b23-d46d8abea93d None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:02.472456 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffa4c37-1eca-4ef8-8b23-d46d8abea93d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:02.554961 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:02.568170 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffa4c37-1eca-4ef8-8b23-d46d8abea93d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:02.569617 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffa4c37-1eca-4ef8-8b23-d46d8abea93d None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:02.630777 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 378/746] 10.222.0.93 () {58 vars in 1023 bytes} [Tue Jul 26 14:39:02 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 14:39:02.665814 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfc88d7-832f-4fc5-b6e8-008f102c08e1 None None] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:02.716156 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 369/747] 10.222.0.93 () {58 vars in 1282 bytes} [Tue Jul 26 14:39:02 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 488 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 14:39:02.737683 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffa4c37-1eca-4ef8-8b23-d46d8abea93d None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:02.846412 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfc88d7-832f-4fc5-b6e8-008f102c08e1 None None] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:02.888999 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3192e6ab-6236-4f23-bafc-0fa132c0e15d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:02.889739 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3192e6ab-6236-4f23-bafc-0fa132c0e15d None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:02.890027 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3192e6ab-6236-4f23-bafc-0fa132c0e15d None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:02.890340 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3192e6ab-6236-4f23-bafc-0fa132c0e15d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:02.904222 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3192e6ab-6236-4f23-bafc-0fa132c0e15d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 14:39:02.909725 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application [None req-3192e6ab-6236-4f23-bafc-0fa132c0e15d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 14:39:02.909725 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:39:02.909725 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:39:02.909725 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:39:02.909725 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:39:02.909725 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:39:02.909725 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:39:02.909725 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:39:02.909725 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:39:02.909725 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:39:02.909725 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:39:02.909725 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:39:02.909725 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 14:39:02.909725 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 14:39:02.909725 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 14:39:02.909725 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 14:39:02.911731 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 14:39:02.911731 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 14:39:02.911731 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 14:39:02.911731 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 14:39:02.911731 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:39:02.911731 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:39:02.911731 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:39:02.911731 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:39:02.911731 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:39:02.911731 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:39:02.911731 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:39:02.911731 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application with Lock( Jul 26 14:39:02.911731 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:39:02.911731 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:39:02.911731 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:39:02.911731 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:39:02.913443 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:39:02.913443 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:39:02.913443 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:39:02.913443 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:39:02.913443 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 14:39:02.913443 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 14:39:02.913443 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 14:39:02.913443 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 14:39:02.913443 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 14:39:02.913443 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 14:39:02.913443 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 14:39:02.913443 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Jul 26 14:39:02.913443 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 379/748] 10.222.0.93 () {56 vars in 1096 bytes} [Tue Jul 26 14:39:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:39:02.921052 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3192e6ab-6236-4f23-bafc-0fa132c0e15d None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:02.930025 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:02.960985 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:03.011343 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffa4c37-1eca-4ef8-8b23-d46d8abea93d None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:03.053741 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3192e6ab-6236-4f23-bafc-0fa132c0e15d None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:03.082984 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6018abb6-f421-4701-903c-49c70d3d2a53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:03.084825 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6018abb6-f421-4701-903c-49c70d3d2a53 None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:03.085839 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6018abb6-f421-4701-903c-49c70d3d2a53 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:03.086793 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6018abb6-f421-4701-903c-49c70d3d2a53 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:03.095582 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01295b43-d425-47a5-9e9f-be428cb3d90f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:03.096232 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01295b43-d425-47a5-9e9f-be428cb3d90f None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:03.096510 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01295b43-d425-47a5-9e9f-be428cb3d90f None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:03.096792 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01295b43-d425-47a5-9e9f-be428cb3d90f None admin] PATH_INFO: `/v3/roles` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:03.097600 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01295b43-d425-47a5-9e9f-be428cb3d90f None admin] RBAC: Adding query filter params (name=admin) {{(pid=87056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:39:03.097914 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01295b43-d425-47a5-9e9f-be428cb3d90f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:03.099580 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01295b43-d425-47a5-9e9f-be428cb3d90f None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:03.110184 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 380/749] 10.222.0.93 () {56 vars in 1099 bytes} [Tue Jul 26 14:39:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:39:03.111388 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb57728-3428-49f2-890a-d41b7c683830 None None] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:03.111752 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb57728-3428-49f2-890a-d41b7c683830 None None] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:03.112038 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb57728-3428-49f2-890a-d41b7c683830 None None] PATH_INFO: `/` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:03.112815 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6018abb6-f421-4701-903c-49c70d3d2a53 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:03.116648 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6018abb6-f421-4701-903c-49c70d3d2a53 None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:03.118542 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 381/750] 10.222.0.93 () {54 vars in 926 bytes} [Tue Jul 26 14:39:03 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:39:03.120038 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ce7284-6e7b-4aa1-8c6a-8ea68e57681b None None] REQUEST_METHOD: `POST` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:03.120337 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ce7284-6e7b-4aa1-8c6a-8ea68e57681b None None] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:03.120621 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ce7284-6e7b-4aa1-8c6a-8ea68e57681b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:03.143188 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.auth.core [None req-77ce7284-6e7b-4aa1-8c6a-8ea68e57681b None None] MFA Rules not processed for user `e5ef88cc058f425b882bcb87a1e1e75c`. Rule list: `[]` (Enabled: `True`). {{(pid=87056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:39:03.144513 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.fernet_utils [None req-77ce7284-6e7b-4aa1-8c6a-8ea68e57681b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:39:03.159836 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application [None req-6018abb6-f421-4701-903c-49c70d3d2a53 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:39:03.159836 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:39:03.159836 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:39:03.159836 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:39:03.159836 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:39:03.159836 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:39:03.159836 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:39:03.159836 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:39:03.159836 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:39:03.159836 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:39:03.159836 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:39:03.159836 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:39:03.159836 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 14:39:03.159836 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 14:39:03.159836 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 14:39:03.162343 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 14:39:03.162343 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:39:03.162343 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:39:03.162343 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:39:03.162343 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:39:03.162343 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:39:03.162343 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:39:03.162343 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:39:03.162343 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application with Lock( Jul 26 14:39:03.162343 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:39:03.162343 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:39:03.162343 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:39:03.162343 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:39:03.162343 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:39:03.162343 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:39:03.162343 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:39:03.162343 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:39:03.164077 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 14:39:03.164077 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 14:39:03.164077 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:39:03.164077 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Jul 26 14:39:03.166353 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 370/751] 10.222.0.93 () {56 vars in 1108 bytes} [Tue Jul 26 14:39:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 426 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 14:39:03.168424 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6018abb6-f421-4701-903c-49c70d3d2a53 None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:03.232494 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:03.250767 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 382/752] 10.222.0.93 () {58 vars in 1023 bytes} [Tue Jul 26 14:39:03 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 14:39:03.252274 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ce7284-6e7b-4aa1-8c6a-8ea68e57681b None None] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:03.401114 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6018abb6-f421-4701-903c-49c70d3d2a53 None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:03.454933 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:03.476030 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511f17b7-6976-4afd-a005-3725692345b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:03.477095 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511f17b7-6976-4afd-a005-3725692345b9 None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:03.477555 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511f17b7-6976-4afd-a005-3725692345b9 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:03.478051 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511f17b7-6976-4afd-a005-3725692345b9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:03.499691 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511f17b7-6976-4afd-a005-3725692345b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:03.502233 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511f17b7-6976-4afd-a005-3725692345b9 None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:03.530839 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application [None req-511f17b7-6976-4afd-a005-3725692345b9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:39:03.530839 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:39:03.530839 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:39:03.530839 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:39:03.530839 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:39:03.530839 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:39:03.530839 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:39:03.530839 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:39:03.530839 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:39:03.530839 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:39:03.530839 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:39:03.530839 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:39:03.530839 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 14:39:03.530839 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 14:39:03.530839 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 14:39:03.532784 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 14:39:03.532784 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:39:03.532784 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:39:03.532784 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:39:03.532784 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:39:03.532784 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:39:03.532784 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:39:03.532784 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:39:03.532784 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application with Lock( Jul 26 14:39:03.532784 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:39:03.532784 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:39:03.532784 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:39:03.532784 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:39:03.532784 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:39:03.532784 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:39:03.532784 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:39:03.532784 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:39:03.535397 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 14:39:03.535397 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 14:39:03.535397 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:39:03.535397 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Jul 26 14:39:03.541027 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ce7284-6e7b-4aa1-8c6a-8ea68e57681b None None] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:03.542276 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 371/753] 10.222.0.93 () {56 vars in 1108 bytes} [Tue Jul 26 14:39:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 375 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:39:03.543895 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511f17b7-6976-4afd-a005-3725692345b9 None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:03.623399 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5271e5-49c8-4c17-bfe3-9d01d1a27210 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:03.624738 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5271e5-49c8-4c17-bfe3-9d01d1a27210 None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:03.625267 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5271e5-49c8-4c17-bfe3-9d01d1a27210 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:03.626093 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5271e5-49c8-4c17-bfe3-9d01d1a27210 None admin] PATH_INFO: `/v3/domains` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:03.628498 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5271e5-49c8-4c17-bfe3-9d01d1a27210 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:39:03.629054 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5271e5-49c8-4c17-bfe3-9d01d1a27210 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:03.634024 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5271e5-49c8-4c17-bfe3-9d01d1a27210 None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:03.654295 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 383/754] 10.222.0.93 () {56 vars in 1109 bytes} [Tue Jul 26 14:39:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 403 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:39:03.655700 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5271e5-49c8-4c17-bfe3-9d01d1a27210 None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:03.735789 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511f17b7-6976-4afd-a005-3725692345b9 None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:03.737772 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:03.801325 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5271e5-49c8-4c17-bfe3-9d01d1a27210 None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:03.810689 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc389c70-1b6b-4812-91b1-c4d9cbcceae3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:03.811338 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc389c70-1b6b-4812-91b1-c4d9cbcceae3 None admin] REQUEST_METHOD: `POST` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:03.811628 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc389c70-1b6b-4812-91b1-c4d9cbcceae3 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:03.811908 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc389c70-1b6b-4812-91b1-c4d9cbcceae3 None admin] PATH_INFO: `/v3/services` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:03.813313 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc389c70-1b6b-4812-91b1-c4d9cbcceae3 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:03.814817 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc389c70-1b6b-4812-91b1-c4d9cbcceae3 None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:03.848214 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ebbaa1-731d-4ecd-84e4-8bd7b7aa08bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:03.849756 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ebbaa1-731d-4ecd-84e4-8bd7b7aa08bd None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:03.850156 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ebbaa1-731d-4ecd-84e4-8bd7b7aa08bd None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:03.850507 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ebbaa1-731d-4ecd-84e4-8bd7b7aa08bd None admin] PATH_INFO: `/v3/domains` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:03.851375 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ebbaa1-731d-4ecd-84e4-8bd7b7aa08bd None admin] RBAC: Adding query filter params (name=Default) {{(pid=87056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:39:03.851760 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ebbaa1-731d-4ecd-84e4-8bd7b7aa08bd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:03.853347 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ebbaa1-731d-4ecd-84e4-8bd7b7aa08bd None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:03.868388 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 384/755] 10.222.0.93 () {56 vars in 1109 bytes} [Tue Jul 26 14:39:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:39:03.869330 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ebbaa1-731d-4ecd-84e4-8bd7b7aa08bd None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:03.937987 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 372/756] 10.222.0.93 () {60 vars in 1141 bytes} [Tue Jul 26 14:39:03 2022] POST /identity/v3/services => generated 240 bytes in 395 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 14:39:03.941306 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc389c70-1b6b-4812-91b1-c4d9cbcceae3 None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:04.034651 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:04.149507 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ebbaa1-731d-4ecd-84e4-8bd7b7aa08bd None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:04.190501 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:04.215534 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc389c70-1b6b-4812-91b1-c4d9cbcceae3 None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:04.238266 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37252a5f-d797-4435-813f-3530336e05c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:04.240485 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37252a5f-d797-4435-813f-3530336e05c6 None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:04.240813 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37252a5f-d797-4435-813f-3530336e05c6 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:04.241104 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37252a5f-d797-4435-813f-3530336e05c6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:04.249927 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37252a5f-d797-4435-813f-3530336e05c6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:04.251556 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37252a5f-d797-4435-813f-3530336e05c6 None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:04.269373 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application [None req-37252a5f-d797-4435-813f-3530336e05c6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 14:39:04.269373 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:39:04.269373 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:39:04.269373 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:39:04.269373 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:39:04.269373 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:39:04.269373 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:39:04.269373 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:39:04.269373 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:39:04.269373 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:39:04.269373 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:39:04.269373 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:39:04.269373 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 14:39:04.269373 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 14:39:04.269373 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 14:39:04.271714 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 14:39:04.271714 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:39:04.271714 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:39:04.271714 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:39:04.271714 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:39:04.271714 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:39:04.271714 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:39:04.271714 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:39:04.271714 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application with Lock( Jul 26 14:39:04.271714 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:39:04.271714 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:39:04.271714 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:39:04.271714 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:39:04.271714 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:39:04.271714 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:39:04.271714 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:39:04.271714 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:39:04.273739 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 14:39:04.273739 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 14:39:04.273739 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 14:39:04.273739 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 14:39:04.273739 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 14:39:04.273739 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 14:39:04.273739 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 14:39:04.273739 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Jul 26 14:39:04.273739 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 385/757] 10.222.0.93 () {56 vars in 1111 bytes} [Tue Jul 26 14:39:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 402 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:39:04.279902 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37252a5f-d797-4435-813f-3530336e05c6 None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:04.294980 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ca8345-9687-428f-b6a0-906526a91077 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:04.296563 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ca8345-9687-428f-b6a0-906526a91077 None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:04.297031 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ca8345-9687-428f-b6a0-906526a91077 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:04.297895 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ca8345-9687-428f-b6a0-906526a91077 None admin] PATH_INFO: `/v3/users/nova` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:04.319712 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ca8345-9687-428f-b6a0-906526a91077 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:04.323600 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ca8345-9687-428f-b6a0-906526a91077 None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:04.352961 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application [None req-31ca8345-9687-428f-b6a0-906526a91077 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 26 14:39:04.352961 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:39:04.352961 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:39:04.352961 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:39:04.352961 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:39:04.352961 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:39:04.352961 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:39:04.352961 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:39:04.352961 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:39:04.352961 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:39:04.352961 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:39:04.352961 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:39:04.352961 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 14:39:04.352961 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 14:39:04.352961 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 14:39:04.352961 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 14:39:04.355209 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:39:04.355209 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:39:04.355209 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 14:39:04.355209 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 14:39:04.355209 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 14:39:04.355209 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 14:39:04.355209 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:39:04.355209 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:39:04.355209 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:39:04.355209 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:39:04.355209 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:39:04.355209 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application with Lock( Jul 26 14:39:04.355209 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:39:04.355209 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:39:04.355209 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:39:04.355209 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:39:04.355209 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:39:04.355209 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:39:04.357750 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:39:04.357750 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:39:04.357750 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 14:39:04.357750 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 14:39:04.357750 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 14:39:04.357750 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 14:39:04.357750 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 14:39:04.357750 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 14:39:04.357750 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 26 14:39:04.357750 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Jul 26 14:39:04.357750 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 373/758] 10.222.0.93 () {56 vars in 1093 bytes} [Tue Jul 26 14:39:03 2022] GET /identity/v3/users/nova => generated 82 bytes in 417 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:39:04.368076 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ca8345-9687-428f-b6a0-906526a91077 None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:04.475149 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37252a5f-d797-4435-813f-3530336e05c6 None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:04.525593 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:04.541914 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ca8345-9687-428f-b6a0-906526a91077 None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:04.565139 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f11f329-50b8-455d-9ef1-dc65cfce4a97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:04.566169 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f11f329-50b8-455d-9ef1-dc65cfce4a97 None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:04.566680 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f11f329-50b8-455d-9ef1-dc65cfce4a97 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:04.567168 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f11f329-50b8-455d-9ef1-dc65cfce4a97 None admin] PATH_INFO: `/v3/projects` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:04.569191 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f11f329-50b8-455d-9ef1-dc65cfce4a97 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:39:04.569741 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f11f329-50b8-455d-9ef1-dc65cfce4a97 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:04.580837 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f11f329-50b8-455d-9ef1-dc65cfce4a97 None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:04.589072 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c039547-85a2-4083-9cf8-c043a0dbeead None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:04.589729 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c039547-85a2-4083-9cf8-c043a0dbeead None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:04.590017 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c039547-85a2-4083-9cf8-c043a0dbeead None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:04.590340 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c039547-85a2-4083-9cf8-c043a0dbeead None admin] PATH_INFO: `/v3/users` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:04.591171 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c039547-85a2-4083-9cf8-c043a0dbeead None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:39:04.591548 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c039547-85a2-4083-9cf8-c043a0dbeead None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:04.593127 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c039547-85a2-4083-9cf8-c043a0dbeead None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:04.617594 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 374/759] 10.222.0.93 () {56 vars in 1133 bytes} [Tue Jul 26 14:39:04 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:39:04.623714 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c039547-85a2-4083-9cf8-c043a0dbeead None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:04.635009 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 386/760] 10.222.0.93 () {56 vars in 1148 bytes} [Tue Jul 26 14:39:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 358 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:39:04.643715 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f11f329-50b8-455d-9ef1-dc65cfce4a97 None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:04.758040 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c039547-85a2-4083-9cf8-c043a0dbeead None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:04.774922 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:04.804114 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950b1133-1f55-4271-aec5-018a7d6f98fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:04.805552 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950b1133-1f55-4271-aec5-018a7d6f98fc None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:04.805878 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950b1133-1f55-4271-aec5-018a7d6f98fc None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:04.806299 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950b1133-1f55-4271-aec5-018a7d6f98fc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:04.823075 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950b1133-1f55-4271-aec5-018a7d6f98fc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:04.824825 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950b1133-1f55-4271-aec5-018a7d6f98fc None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:04.843889 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application [None req-950b1133-1f55-4271-aec5-018a7d6f98fc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:39:04.843889 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:39:04.843889 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:39:04.843889 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:39:04.843889 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:39:04.843889 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:39:04.843889 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:39:04.843889 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:39:04.843889 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:39:04.843889 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:39:04.843889 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:39:04.843889 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:39:04.843889 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 14:39:04.843889 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 14:39:04.843889 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 14:39:04.846139 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 14:39:04.846139 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:39:04.846139 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:39:04.846139 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:39:04.846139 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:39:04.846139 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:39:04.846139 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:39:04.846139 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:39:04.846139 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application with Lock( Jul 26 14:39:04.846139 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:39:04.846139 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:39:04.846139 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:39:04.846139 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:39:04.846139 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:39:04.846139 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:39:04.846139 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:39:04.846139 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:39:04.848094 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 14:39:04.848094 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 14:39:04.848094 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:39:04.848094 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Jul 26 14:39:04.848094 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 375/761] 10.222.0.93 () {56 vars in 1108 bytes} [Tue Jul 26 14:39:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:39:04.848094 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:04.851636 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950b1133-1f55-4271-aec5-018a7d6f98fc None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:04.986134 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950b1133-1f55-4271-aec5-018a7d6f98fc None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:05.032251 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccfc388-b962-479d-a104-fd29e29fb8dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:05.032998 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccfc388-b962-479d-a104-fd29e29fb8dc None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:05.033687 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccfc388-b962-479d-a104-fd29e29fb8dc None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:05.034053 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccfc388-b962-479d-a104-fd29e29fb8dc None admin] PATH_INFO: `/v3/domains` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:05.034914 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccfc388-b962-479d-a104-fd29e29fb8dc None admin] RBAC: Adding query filter params (name=Default) {{(pid=87055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:39:05.035302 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccfc388-b962-479d-a104-fd29e29fb8dc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:05.036863 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccfc388-b962-479d-a104-fd29e29fb8dc None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:05.057790 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 376/762] 10.222.0.93 () {56 vars in 1109 bytes} [Tue Jul 26 14:39:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:39:05.060055 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccfc388-b962-479d-a104-fd29e29fb8dc None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:05.096321 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f11f329-50b8-455d-9ef1-dc65cfce4a97 None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:05.146615 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:05.200338 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccfc388-b962-479d-a104-fd29e29fb8dc None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:05.210540 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d63671-1ecf-4184-86c8-cfd2795e1352 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:05.213597 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d63671-1ecf-4184-86c8-cfd2795e1352 None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:05.215279 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d63671-1ecf-4184-86c8-cfd2795e1352 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:05.216097 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d63671-1ecf-4184-86c8-cfd2795e1352 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:05.219015 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d63671-1ecf-4184-86c8-cfd2795e1352 None admin] RBAC: Adding query filter params (role.id=94e105ff8ee4486abd501415cc05ba38, scope.project.id=c422a2290a14424da20e2841cbc1741d, user.id=b914b2ba87e74def85f9694e1141e00b) {{(pid=87056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:39:05.219837 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d63671-1ecf-4184-86c8-cfd2795e1352 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:05.224687 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d63671-1ecf-4184-86c8-cfd2795e1352 None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:05.244555 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 387/763] 10.222.0.93 () {56 vars in 1374 bytes} [Tue Jul 26 14:39:04 2022] GET /identity/v3/role_assignments?user.id=b914b2ba87e74def85f9694e1141e00b&scope.project.id=c422a2290a14424da20e2841cbc1741d&role.id=94e105ff8ee4486abd501415cc05ba38 => generated 259 bytes in 595 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:39:05.244555 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46d543c-b7d1-46c9-9d81-85738c6888d2 None None] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:05.244555 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46d543c-b7d1-46c9-9d81-85738c6888d2 None None] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:05.244555 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46d543c-b7d1-46c9-9d81-85738c6888d2 None None] PATH_INFO: `/` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:05.244555 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 388/764] 10.222.0.93 () {54 vars in 926 bytes} [Tue Jul 26 14:39:05 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:39:05.257797 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0237084-9c1e-4177-a254-f9f3791faf7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:05.258739 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0237084-9c1e-4177-a254-f9f3791faf7d None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:05.259025 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0237084-9c1e-4177-a254-f9f3791faf7d None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:05.259305 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0237084-9c1e-4177-a254-f9f3791faf7d None admin] PATH_INFO: `/v3/projects/service` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:05.267720 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0237084-9c1e-4177-a254-f9f3791faf7d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:05.270280 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61a404c-d3ff-4699-a2e6-e0f2d3cc21e4 None None] REQUEST_METHOD: `POST` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:05.270709 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61a404c-d3ff-4699-a2e6-e0f2d3cc21e4 None None] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:05.271198 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61a404c-d3ff-4699-a2e6-e0f2d3cc21e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:05.279018 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0237084-9c1e-4177-a254-f9f3791faf7d None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:05.297039 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application [None req-d0237084-9c1e-4177-a254-f9f3791faf7d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 14:39:05.297039 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:39:05.297039 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:39:05.297039 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:39:05.297039 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:39:05.297039 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:39:05.297039 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:39:05.297039 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:39:05.297039 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:39:05.297039 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:39:05.297039 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:39:05.297039 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:39:05.297039 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 14:39:05.297039 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 14:39:05.297039 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 14:39:05.299132 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 14:39:05.299132 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:39:05.299132 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:39:05.299132 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:39:05.299132 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:39:05.299132 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:39:05.299132 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:39:05.299132 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:39:05.299132 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application with Lock( Jul 26 14:39:05.299132 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:39:05.299132 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:39:05.299132 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:39:05.299132 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:39:05.299132 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:39:05.299132 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:39:05.299132 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:39:05.299132 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:39:05.306881 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 14:39:05.306881 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 14:39:05.306881 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 14:39:05.306881 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 14:39:05.306881 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 14:39:05.306881 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 14:39:05.306881 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 14:39:05.306881 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Jul 26 14:39:05.306881 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 377/765] 10.222.0.93 () {56 vars in 1111 bytes} [Tue Jul 26 14:39:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 14:39:05.306881 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0237084-9c1e-4177-a254-f9f3791faf7d None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:05.321899 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.auth.core [None req-d61a404c-d3ff-4699-a2e6-e0f2d3cc21e4 None None] MFA Rules not processed for user `e5ef88cc058f425b882bcb87a1e1e75c`. Rule list: `[]` (Enabled: `True`). {{(pid=87056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:39:05.323507 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.fernet_utils [None req-d61a404c-d3ff-4699-a2e6-e0f2d3cc21e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:39:05.509918 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 389/766] 10.222.0.93 () {58 vars in 1023 bytes} [Tue Jul 26 14:39:05 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 26 14:39:05.558665 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61a404c-d3ff-4699-a2e6-e0f2d3cc21e4 None None] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:05.587714 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0237084-9c1e-4177-a254-f9f3791faf7d None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:05.623018 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:05.635076 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8430e204-954e-4d87-b9fa-a5565942da56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:05.636070 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8430e204-954e-4d87-b9fa-a5565942da56 None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:05.641548 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8430e204-954e-4d87-b9fa-a5565942da56 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:05.641548 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8430e204-954e-4d87-b9fa-a5565942da56 None admin] PATH_INFO: `/v3/projects` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:05.641548 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8430e204-954e-4d87-b9fa-a5565942da56 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:39:05.641940 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:05.642075 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8430e204-954e-4d87-b9fa-a5565942da56 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:05.642075 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8430e204-954e-4d87-b9fa-a5565942da56 None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:05.680773 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 378/767] 10.222.0.93 () {56 vars in 1148 bytes} [Tue Jul 26 14:39:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 379 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:39:05.687082 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8430e204-954e-4d87-b9fa-a5565942da56 None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:05.799186 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61a404c-d3ff-4699-a2e6-e0f2d3cc21e4 None None] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:05.865083 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69533a3-9ee9-4967-b1de-097642088cd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:05.866130 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69533a3-9ee9-4967-b1de-097642088cd4 None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:05.866685 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69533a3-9ee9-4967-b1de-097642088cd4 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:05.867220 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69533a3-9ee9-4967-b1de-097642088cd4 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:05.868315 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69533a3-9ee9-4967-b1de-097642088cd4 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:05.870905 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69533a3-9ee9-4967-b1de-097642088cd4 None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:05.891060 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application [None req-d69533a3-9ee9-4967-b1de-097642088cd4 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 26 14:39:05.891060 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:39:05.891060 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 14:39:05.891060 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 14:39:05.891060 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 14:39:05.891060 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 14:39:05.891060 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 14:39:05.891060 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 14:39:05.891060 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 26 14:39:05.891060 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Jul 26 14:39:05.891060 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 14:39:05.891060 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Jul 26 14:39:05.891060 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:39:05.891060 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:39:05.891060 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:39:05.891060 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:39:05.892080 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:39:05.892080 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:39:05.892080 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:39:05.892080 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:39:05.892080 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:39:05.892080 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:39:05.892080 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:39:05.892080 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 14:39:05.892080 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 14:39:05.892080 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 14:39:05.892080 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 14:39:05.892080 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:39:05.892080 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:39:05.892080 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:39:05.892080 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:39:05.892080 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:39:05.892928 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:39:05.892928 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:39:05.892928 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application with Lock( Jul 26 14:39:05.892928 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:39:05.892928 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:39:05.892928 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:39:05.892928 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:39:05.892928 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:39:05.892928 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:39:05.892928 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:39:05.892928 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:39:05.892928 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 14:39:05.892928 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 14:39:05.892928 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 26 14:39:05.892928 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Jul 26 14:39:05.893717 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 390/768] 10.222.0.93 () {56 vars in 1129 bytes} [Tue Jul 26 14:39:05 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 335 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 14:39:05.896106 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9728c412-aa53-4e25-8215-08f81564a386 None None] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:05.902275 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9728c412-aa53-4e25-8215-08f81564a386 None None] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:05.902275 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9728c412-aa53-4e25-8215-08f81564a386 None None] PATH_INFO: `/` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:05.902275 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 391/769] 10.222.0.93 () {54 vars in 926 bytes} [Tue Jul 26 14:39:05 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:39:05.912198 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677b526f-1491-44d7-b44c-b76e89f4c918 None None] REQUEST_METHOD: `POST` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:05.912683 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677b526f-1491-44d7-b44c-b76e89f4c918 None None] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:05.913011 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8430e204-954e-4d87-b9fa-a5565942da56 None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:05.913165 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677b526f-1491-44d7-b44c-b76e89f4c918 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:05.941532 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.auth.core [None req-677b526f-1491-44d7-b44c-b76e89f4c918 None None] MFA Rules not processed for user `e5ef88cc058f425b882bcb87a1e1e75c`. Rule list: `[]` (Enabled: `True`). {{(pid=87056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:39:05.948064 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.fernet_utils [None req-677b526f-1491-44d7-b44c-b76e89f4c918 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:39:05.975507 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469bd9b0-3ff5-4ae6-81dc-6702fbad987a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:05.976550 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469bd9b0-3ff5-4ae6-81dc-6702fbad987a None admin] REQUEST_METHOD: `PUT` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:05.976973 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469bd9b0-3ff5-4ae6-81dc-6702fbad987a None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:05.977416 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469bd9b0-3ff5-4ae6-81dc-6702fbad987a None admin] PATH_INFO: `/v3/projects/c422a2290a14424da20e2841cbc1741d/users/2e86fe36c9bf49a481c9f15ac7571b88/roles/94e105ff8ee4486abd501415cc05ba38` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:05.980900 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469bd9b0-3ff5-4ae6-81dc-6702fbad987a None admin] RBAC: Authorizing `identity:create_grant(project_id=c422a2290a14424da20e2841cbc1741d, user_id=2e86fe36c9bf49a481c9f15ac7571b88, role_id=94e105ff8ee4486abd501415cc05ba38)` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:05.983897 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469bd9b0-3ff5-4ae6-81dc-6702fbad987a None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:06.057486 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 392/770] 10.222.0.93 () {58 vars in 1023 bytes} [Tue Jul 26 14:39:05 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 14:39:06.058782 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677b526f-1491-44d7-b44c-b76e89f4c918 None None] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:06.093786 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 379/771] 10.222.0.93 () {58 vars in 1439 bytes} [Tue Jul 26 14:39:05 2022] PUT /identity/v3/projects/c422a2290a14424da20e2841cbc1741d/users/2e86fe36c9bf49a481c9f15ac7571b88/roles/94e105ff8ee4486abd501415cc05ba38 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 14:39:06.101248 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469bd9b0-3ff5-4ae6-81dc-6702fbad987a None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:06.165125 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:06.294737 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:06.311659 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677b526f-1491-44d7-b44c-b76e89f4c918 None None] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:06.368251 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ca3c64-8973-432b-825b-63e31de3c1c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:06.368906 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ca3c64-8973-432b-825b-63e31de3c1c0 None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:06.369191 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ca3c64-8973-432b-825b-63e31de3c1c0 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:06.369466 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ca3c64-8973-432b-825b-63e31de3c1c0 None admin] PATH_INFO: `/v3/services` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:06.370270 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ca3c64-8973-432b-825b-63e31de3c1c0 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=87056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:39:06.371604 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ca3c64-8973-432b-825b-63e31de3c1c0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:06.374468 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ca3c64-8973-432b-825b-63e31de3c1c0 None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:06.381923 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 393/772] 10.222.0.93 () {56 vars in 1124 bytes} [Tue Jul 26 14:39:06 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:39:06.391148 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ca3c64-8973-432b-825b-63e31de3c1c0 None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:06.395199 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469bd9b0-3ff5-4ae6-81dc-6702fbad987a None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:06.459242 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea759b0-7249-43d5-b452-e035f646ffb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:06.459898 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea759b0-7249-43d5-b452-e035f646ffb2 None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:06.460203 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea759b0-7249-43d5-b452-e035f646ffb2 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:06.460518 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea759b0-7249-43d5-b452-e035f646ffb2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:06.476888 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea759b0-7249-43d5-b452-e035f646ffb2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 14:39:06.483222 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application [None req-5ea759b0-7249-43d5-b452-e035f646ffb2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 26 14:39:06.483222 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:39:06.483222 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:39:06.483222 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:39:06.483222 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:39:06.483222 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:39:06.483222 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:39:06.483222 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:39:06.483222 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:39:06.483222 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:39:06.483222 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:39:06.483222 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:39:06.483222 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 14:39:06.483222 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 14:39:06.483222 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 14:39:06.483222 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 14:39:06.484577 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 14:39:06.484577 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 14:39:06.484577 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 14:39:06.484577 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 14:39:06.484577 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:39:06.484577 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:39:06.484577 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:39:06.484577 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:39:06.484577 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:39:06.484577 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:39:06.484577 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:39:06.484577 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application with Lock( Jul 26 14:39:06.484577 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:39:06.484577 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:39:06.484577 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:39:06.484577 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:39:06.486061 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:39:06.486061 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:39:06.486061 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:39:06.486061 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:39:06.486061 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 14:39:06.486061 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 14:39:06.486061 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 14:39:06.486061 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 14:39:06.486061 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 14:39:06.486061 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 14:39:06.486061 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 26 14:39:06.486061 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Jul 26 14:39:06.486061 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 380/773] 10.222.0.93 () {56 vars in 1102 bytes} [Tue Jul 26 14:39:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 386 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 14:39:06.499368 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea759b0-7249-43d5-b452-e035f646ffb2 None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:06.546855 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:06.565927 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ca3c64-8973-432b-825b-63e31de3c1c0 None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:06.609279 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cd0325-dc15-40f2-afdd-06159e0eff4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:06.610319 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cd0325-dc15-40f2-afdd-06159e0eff4b None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:06.610809 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cd0325-dc15-40f2-afdd-06159e0eff4b None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:06.611306 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cd0325-dc15-40f2-afdd-06159e0eff4b None admin] PATH_INFO: `/v3/services` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:06.612213 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cd0325-dc15-40f2-afdd-06159e0eff4b None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=87056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:39:06.612712 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cd0325-dc15-40f2-afdd-06159e0eff4b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:06.614457 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cd0325-dc15-40f2-afdd-06159e0eff4b None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:06.630524 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 394/774] 10.222.0.93 () {56 vars in 1124 bytes} [Tue Jul 26 14:39:06 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:39:06.639950 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cd0325-dc15-40f2-afdd-06159e0eff4b None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:06.686225 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:06.689236 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea759b0-7249-43d5-b452-e035f646ffb2 None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:06.738669 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b4836b-622e-4e0e-8ed1-5dbd5c9495c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:06.739365 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b4836b-622e-4e0e-8ed1-5dbd5c9495c2 None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:06.739798 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b4836b-622e-4e0e-8ed1-5dbd5c9495c2 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:06.740377 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b4836b-622e-4e0e-8ed1-5dbd5c9495c2 None admin] PATH_INFO: `/v3/roles` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:06.741291 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b4836b-622e-4e0e-8ed1-5dbd5c9495c2 None admin] RBAC: Adding query filter params (name=service) {{(pid=87055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:39:06.741663 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b4836b-622e-4e0e-8ed1-5dbd5c9495c2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:06.743233 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b4836b-622e-4e0e-8ed1-5dbd5c9495c2 None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:06.753878 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 381/775] 10.222.0.93 () {56 vars in 1103 bytes} [Tue Jul 26 14:39:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:39:06.764056 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b4836b-622e-4e0e-8ed1-5dbd5c9495c2 None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:06.957248 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b4836b-622e-4e0e-8ed1-5dbd5c9495c2 None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:06.987327 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cd0325-dc15-40f2-afdd-06159e0eff4b None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:07.040350 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fb72ea-78bc-4b79-ab17-974d4901cea1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:07.040910 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fb72ea-78bc-4b79-ab17-974d4901cea1 None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:07.041192 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fb72ea-78bc-4b79-ab17-974d4901cea1 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:07.041475 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fb72ea-78bc-4b79-ab17-974d4901cea1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:07.042277 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fb72ea-78bc-4b79-ab17-974d4901cea1 None admin] RBAC: Adding query filter params (interface=public, service_id=c3cd3372e6de4490a963fa9c610398e5, region_id=RegionOne) {{(pid=87056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:39:07.042610 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fb72ea-78bc-4b79-ab17-974d4901cea1 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:07.049248 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fb72ea-78bc-4b79-ab17-974d4901cea1 None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:07.062776 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8d04d0-f2cd-4624-931f-7ff803aabdf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:07.063536 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8d04d0-f2cd-4624-931f-7ff803aabdf4 None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:07.063830 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8d04d0-f2cd-4624-931f-7ff803aabdf4 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:07.064088 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8d04d0-f2cd-4624-931f-7ff803aabdf4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:07.066778 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 395/776] 10.222.0.93 () {56 vars in 1251 bytes} [Tue Jul 26 14:39:06 2022] GET /identity/v3/endpoints?service_id=c3cd3372e6de4490a963fa9c610398e5&interface=public®ion_id=RegionOne => generated 194 bytes in 427 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:39:07.076344 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fb72ea-78bc-4b79-ab17-974d4901cea1 None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:07.100525 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8d04d0-f2cd-4624-931f-7ff803aabdf4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:07.103891 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8d04d0-f2cd-4624-931f-7ff803aabdf4 None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:07.108248 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:07.137748 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application [None req-0a8d04d0-f2cd-4624-931f-7ff803aabdf4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:39:07.137748 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:39:07.137748 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:39:07.137748 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:39:07.137748 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:39:07.137748 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:39:07.137748 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:39:07.137748 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:39:07.137748 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:39:07.137748 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:39:07.137748 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:39:07.137748 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:39:07.137748 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 14:39:07.137748 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 14:39:07.137748 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 14:39:07.138760 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 14:39:07.138760 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:39:07.138760 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:39:07.138760 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:39:07.138760 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:39:07.138760 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:39:07.138760 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:39:07.138760 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:39:07.138760 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application with Lock( Jul 26 14:39:07.138760 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:39:07.138760 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:39:07.138760 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:39:07.138760 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:39:07.138760 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:39:07.138760 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:39:07.138760 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:39:07.138760 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:39:07.139744 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 14:39:07.139744 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 14:39:07.139744 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:39:07.139744 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Jul 26 14:39:07.146460 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 382/777] 10.222.0.93 () {56 vars in 1108 bytes} [Tue Jul 26 14:39:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 376 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:39:07.148562 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8d04d0-f2cd-4624-931f-7ff803aabdf4 None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:07.192033 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:07.252147 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fb72ea-78bc-4b79-ab17-974d4901cea1 None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:07.301585 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e216854-ef4f-43ae-8364-1728678c927a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:07.305486 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e216854-ef4f-43ae-8364-1728678c927a None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:07.307910 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e216854-ef4f-43ae-8364-1728678c927a None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:07.308486 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e216854-ef4f-43ae-8364-1728678c927a None admin] PATH_INFO: `/v3/services` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:07.309445 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e216854-ef4f-43ae-8364-1728678c927a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:07.311528 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e216854-ef4f-43ae-8364-1728678c927a None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:07.325000 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 396/778] 10.222.0.93 () {56 vars in 1087 bytes} [Tue Jul 26 14:39:07 2022] GET /identity/v3/services => generated 772 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:39:07.386163 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8d04d0-f2cd-4624-931f-7ff803aabdf4 None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:07.441942 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2293e1-1658-4205-9e2c-2c9f5a0f0673 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:07.443060 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2293e1-1658-4205-9e2c-2c9f5a0f0673 None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:07.443565 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2293e1-1658-4205-9e2c-2c9f5a0f0673 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:07.444050 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2293e1-1658-4205-9e2c-2c9f5a0f0673 None admin] PATH_INFO: `/v3/domains` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:07.444998 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2293e1-1658-4205-9e2c-2c9f5a0f0673 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:39:07.445556 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2293e1-1658-4205-9e2c-2c9f5a0f0673 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:07.447260 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2293e1-1658-4205-9e2c-2c9f5a0f0673 None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:07.469265 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 383/779] 10.222.0.93 () {56 vars in 1109 bytes} [Tue Jul 26 14:39:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:39:07.478806 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e216854-ef4f-43ae-8364-1728678c927a None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:07.619131 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:07.644363 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e216854-ef4f-43ae-8364-1728678c927a None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:07.690209 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e901b7-424a-4a74-8581-3a422dc857d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:07.690943 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e901b7-424a-4a74-8581-3a422dc857d2 None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:07.691232 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e901b7-424a-4a74-8581-3a422dc857d2 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:07.691520 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e901b7-424a-4a74-8581-3a422dc857d2 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:07.701391 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e901b7-424a-4a74-8581-3a422dc857d2 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:07.705758 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e901b7-424a-4a74-8581-3a422dc857d2 None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:07.720917 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application [None req-52e901b7-424a-4a74-8581-3a422dc857d2 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 26 14:39:07.720917 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:39:07.720917 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:39:07.720917 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:39:07.720917 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:39:07.720917 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:39:07.720917 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:39:07.720917 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:39:07.720917 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:39:07.720917 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:39:07.720917 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:39:07.720917 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:39:07.720917 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 14:39:07.720917 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 14:39:07.720917 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 14:39:07.720917 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 14:39:07.723684 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:39:07.723684 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:39:07.723684 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 14:39:07.723684 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 14:39:07.723684 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 14:39:07.723684 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 14:39:07.723684 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:39:07.723684 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:39:07.723684 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:39:07.723684 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:39:07.723684 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:39:07.723684 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application with Lock( Jul 26 14:39:07.723684 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:39:07.723684 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:39:07.723684 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:39:07.723684 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:39:07.723684 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:39:07.723684 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:39:07.725579 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:39:07.725579 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:39:07.725579 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 14:39:07.725579 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 14:39:07.725579 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 14:39:07.725579 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 14:39:07.725579 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 14:39:07.725579 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 14:39:07.725579 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 26 14:39:07.725579 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Jul 26 14:39:07.725579 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 397/780] 10.222.0.93 () {56 vars in 1117 bytes} [Tue Jul 26 14:39:07 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:39:07.728959 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2293e1-1658-4205-9e2c-2c9f5a0f0673 None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:07.837199 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:07.868791 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2293e1-1658-4205-9e2c-2c9f5a0f0673 None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:07.921820 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ed7071-4c64-4b4e-a710-55d7a3274e9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:07.923227 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ed7071-4c64-4b4e-a710-55d7a3274e9d None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:07.923917 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ed7071-4c64-4b4e-a710-55d7a3274e9d None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:07.924583 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ed7071-4c64-4b4e-a710-55d7a3274e9d None admin] PATH_INFO: `/v3/users` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:07.926214 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ed7071-4c64-4b4e-a710-55d7a3274e9d None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=87055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:39:07.927482 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ed7071-4c64-4b4e-a710-55d7a3274e9d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:07.930679 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ed7071-4c64-4b4e-a710-55d7a3274e9d None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:07.941420 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e71d5a1-db78-4756-a691-b8b7daae5224 None None] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:07.941829 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e71d5a1-db78-4756-a691-b8b7daae5224 None None] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:07.941979 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e71d5a1-db78-4756-a691-b8b7daae5224 None None] PATH_INFO: `/` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:07.950217 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 398/781] 10.222.0.93 () {54 vars in 926 bytes} [Tue Jul 26 14:39:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:39:07.959200 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 384/782] 10.222.0.93 () {56 vars in 1149 bytes} [Tue Jul 26 14:39:07 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:39:07.963649 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4682e1b7-cc35-4bd0-bc62-706071c3e16c None None] REQUEST_METHOD: `POST` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:07.964030 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4682e1b7-cc35-4bd0-bc62-706071c3e16c None None] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:07.964320 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4682e1b7-cc35-4bd0-bc62-706071c3e16c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:07.967457 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ed7071-4c64-4b4e-a710-55d7a3274e9d None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:08.011894 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.auth.core [None req-4682e1b7-cc35-4bd0-bc62-706071c3e16c None None] MFA Rules not processed for user `e5ef88cc058f425b882bcb87a1e1e75c`. Rule list: `[]` (Enabled: `True`). {{(pid=87056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:39:08.013292 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.fernet_utils [None req-4682e1b7-cc35-4bd0-bc62-706071c3e16c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:39:08.098912 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ed7071-4c64-4b4e-a710-55d7a3274e9d None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:08.142331 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17356f7a-1f0e-4e6b-8431-f2d58a6deeeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:08.144063 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17356f7a-1f0e-4e6b-8431-f2d58a6deeeb None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:08.144422 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17356f7a-1f0e-4e6b-8431-f2d58a6deeeb None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:08.144775 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17356f7a-1f0e-4e6b-8431-f2d58a6deeeb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:08.154629 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:08.159637 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17356f7a-1f0e-4e6b-8431-f2d58a6deeeb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:08.161551 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17356f7a-1f0e-4e6b-8431-f2d58a6deeeb None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:08.181586 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application [None req-17356f7a-1f0e-4e6b-8431-f2d58a6deeeb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:39:08.181586 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:39:08.181586 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:39:08.181586 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:39:08.181586 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:39:08.181586 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:39:08.181586 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:39:08.181586 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:39:08.181586 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:39:08.181586 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:39:08.181586 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:39:08.181586 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:39:08.181586 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 14:39:08.181586 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 14:39:08.181586 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 14:39:08.183686 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 14:39:08.183686 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:39:08.183686 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:39:08.183686 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:39:08.183686 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:39:08.183686 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:39:08.183686 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:39:08.183686 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:39:08.183686 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application with Lock( Jul 26 14:39:08.183686 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:39:08.183686 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:39:08.183686 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:39:08.183686 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:39:08.183686 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:39:08.183686 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:39:08.183686 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:39:08.183686 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:39:08.185339 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 14:39:08.185339 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 14:39:08.185339 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:39:08.185339 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Jul 26 14:39:08.185339 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 385/783] 10.222.0.93 () {56 vars in 1108 bytes} [Tue Jul 26 14:39:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:39:08.190818 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17356f7a-1f0e-4e6b-8431-f2d58a6deeeb None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:08.349894 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 399/784] 10.222.0.93 () {58 vars in 1023 bytes} [Tue Jul 26 14:39:07 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 387 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 26 14:39:08.388794 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4682e1b7-cc35-4bd0-bc62-706071c3e16c None None] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:08.426292 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17356f7a-1f0e-4e6b-8431-f2d58a6deeeb None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:08.552962 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5830d53-bb21-4f5e-945b-b5cc485966aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:08.554651 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5830d53-bb21-4f5e-945b-b5cc485966aa None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:08.555498 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5830d53-bb21-4f5e-945b-b5cc485966aa None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:08.556310 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5830d53-bb21-4f5e-945b-b5cc485966aa None admin] PATH_INFO: `/v3/domains` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:08.557988 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5830d53-bb21-4f5e-945b-b5cc485966aa None admin] RBAC: Adding query filter params (name=Default) {{(pid=87055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:39:08.561465 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5830d53-bb21-4f5e-945b-b5cc485966aa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:08.564671 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5830d53-bb21-4f5e-945b-b5cc485966aa None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:08.597649 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 386/785] 10.222.0.93 () {56 vars in 1109 bytes} [Tue Jul 26 14:39:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 407 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:39:08.604229 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5830d53-bb21-4f5e-945b-b5cc485966aa None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:08.644828 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:08.721513 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:08.769461 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4682e1b7-cc35-4bd0-bc62-706071c3e16c None None] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:08.824888 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5830d53-bb21-4f5e-945b-b5cc485966aa None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:08.835182 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2080018-634c-47c7-9164-5fc2f8fe8c24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:08.836559 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2080018-634c-47c7-9164-5fc2f8fe8c24 None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:08.837274 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2080018-634c-47c7-9164-5fc2f8fe8c24 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:08.837950 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2080018-634c-47c7-9164-5fc2f8fe8c24 None admin] PATH_INFO: `/v3/services/network` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:08.839524 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2080018-634c-47c7-9164-5fc2f8fe8c24 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:08.842716 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2080018-634c-47c7-9164-5fc2f8fe8c24 None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:08.861096 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application [None req-e2080018-634c-47c7-9164-5fc2f8fe8c24 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 26 14:39:08.861096 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:39:08.861096 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 14:39:08.861096 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 14:39:08.861096 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 14:39:08.861096 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 14:39:08.861096 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 14:39:08.861096 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 14:39:08.861096 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 26 14:39:08.861096 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Jul 26 14:39:08.861096 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 14:39:08.861096 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Jul 26 14:39:08.861096 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:39:08.861096 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:39:08.861096 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:39:08.861096 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:39:08.861096 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:39:08.862538 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:39:08.862538 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:39:08.862538 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:39:08.862538 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:39:08.862538 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:39:08.862538 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:39:08.862538 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 14:39:08.862538 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 14:39:08.862538 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 14:39:08.862538 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 14:39:08.862538 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:39:08.862538 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:39:08.862538 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:39:08.862538 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:39:08.862538 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:39:08.862538 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:39:08.864054 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:39:08.864054 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application with Lock( Jul 26 14:39:08.864054 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:39:08.864054 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:39:08.864054 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:39:08.864054 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:39:08.864054 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:39:08.864054 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:39:08.864054 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:39:08.864054 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:39:08.864054 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 14:39:08.864054 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 14:39:08.864054 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 26 14:39:08.864054 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Jul 26 14:39:08.867579 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 400/786] 10.222.0.93 () {56 vars in 1111 bytes} [Tue Jul 26 14:39:08 2022] GET /identity/v3/services/network => generated 88 bytes in 480 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:39:08.869900 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f563cd7e-88e0-45f6-9f62-36968efea395 None None] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:08.870210 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f563cd7e-88e0-45f6-9f62-36968efea395 None None] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:08.870486 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f563cd7e-88e0-45f6-9f62-36968efea395 None None] PATH_INFO: `/` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:08.872105 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 401/787] 10.222.0.93 () {54 vars in 926 bytes} [Tue Jul 26 14:39:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:39:08.876762 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0727831-2ad3-4ad7-8bec-a82aaa99a424 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:08.877052 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f563cd7e-88e0-45f6-9f62-36968efea395 None None] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:08.878689 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0727831-2ad3-4ad7-8bec-a82aaa99a424 None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:08.879464 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0727831-2ad3-4ad7-8bec-a82aaa99a424 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:08.880756 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0727831-2ad3-4ad7-8bec-a82aaa99a424 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:08.890831 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0727831-2ad3-4ad7-8bec-a82aaa99a424 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:08.892425 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0727831-2ad3-4ad7-8bec-a82aaa99a424 None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:08.906651 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application [None req-a0727831-2ad3-4ad7-8bec-a82aaa99a424 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 14:39:08.906651 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:39:08.906651 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:39:08.906651 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:39:08.906651 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:39:08.906651 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:39:08.906651 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:39:08.906651 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:39:08.906651 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:39:08.906651 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:39:08.906651 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:39:08.906651 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:39:08.906651 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 14:39:08.906651 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 14:39:08.906651 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 14:39:08.908408 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 14:39:08.908408 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:39:08.908408 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:39:08.908408 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:39:08.908408 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:39:08.908408 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:39:08.908408 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:39:08.908408 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:39:08.908408 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application with Lock( Jul 26 14:39:08.908408 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:39:08.908408 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:39:08.908408 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:39:08.908408 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:39:08.908408 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:39:08.908408 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:39:08.908408 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:39:08.908408 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:39:08.910269 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 14:39:08.910269 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 14:39:08.910269 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 14:39:08.910269 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 14:39:08.910269 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 14:39:08.910269 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 14:39:08.910269 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 14:39:08.910269 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Jul 26 14:39:08.910269 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 387/788] 10.222.0.93 () {56 vars in 1111 bytes} [Tue Jul 26 14:39:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:39:08.910269 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c3d11d-cbff-462b-8a4f-e0c54e0c0aae None None] REQUEST_METHOD: `POST` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:08.910269 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c3d11d-cbff-462b-8a4f-e0c54e0c0aae None None] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:08.913152 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c3d11d-cbff-462b-8a4f-e0c54e0c0aae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:08.932086 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.auth.core [None req-69c3d11d-cbff-462b-8a4f-e0c54e0c0aae None None] MFA Rules not processed for user `e5ef88cc058f425b882bcb87a1e1e75c`. Rule list: `[]` (Enabled: `True`). {{(pid=87055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:39:08.932921 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.fernet_utils [None req-69c3d11d-cbff-462b-8a4f-e0c54e0c0aae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:39:09.010717 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 388/789] 10.222.0.93 () {58 vars in 1023 bytes} [Tue Jul 26 14:39:08 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 14:39:09.019584 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c3d11d-cbff-462b-8a4f-e0c54e0c0aae None None] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:09.056643 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f563cd7e-88e0-45f6-9f62-36968efea395 None None] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:09.075866 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:09.096119 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:09.102683 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f88904f-0da0-4b98-bca6-4a1b5515b401 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:09.103329 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f88904f-0da0-4b98-bca6-4a1b5515b401 None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:09.103941 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f88904f-0da0-4b98-bca6-4a1b5515b401 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:09.103941 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f88904f-0da0-4b98-bca6-4a1b5515b401 None admin] PATH_INFO: `/v3/services` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:09.104700 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f88904f-0da0-4b98-bca6-4a1b5515b401 None admin] RBAC: Adding query filter params (name=network) {{(pid=87056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:39:09.104969 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f88904f-0da0-4b98-bca6-4a1b5515b401 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:09.106375 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f88904f-0da0-4b98-bca6-4a1b5515b401 None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:09.115948 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 402/790] 10.222.0.93 () {56 vars in 1112 bytes} [Tue Jul 26 14:39:08 2022] GET /identity/v3/services?name=network => generated 124 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:39:09.115948 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47e0e8d-9a53-4e28-aa53-25c93184fe6c None None] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:09.115948 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47e0e8d-9a53-4e28-aa53-25c93184fe6c None None] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:09.115948 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47e0e8d-9a53-4e28-aa53-25c93184fe6c None None] PATH_INFO: `/` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:09.115948 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 403/791] 10.222.0.93 () {54 vars in 926 bytes} [Tue Jul 26 14:39:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:39:09.116797 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47e0e8d-9a53-4e28-aa53-25c93184fe6c None None] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:09.176383 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c3d11d-cbff-462b-8a4f-e0c54e0c0aae None None] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:09.227165 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cc4381-f729-4d1f-aa08-215d581de248 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:09.227808 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cc4381-f729-4d1f-aa08-215d581de248 None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:09.228154 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cc4381-f729-4d1f-aa08-215d581de248 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:09.228435 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cc4381-f729-4d1f-aa08-215d581de248 None admin] PATH_INFO: `/v3/projects` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:09.229229 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cc4381-f729-4d1f-aa08-215d581de248 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:39:09.229543 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cc4381-f729-4d1f-aa08-215d581de248 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:09.231080 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cc4381-f729-4d1f-aa08-215d581de248 None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:09.250215 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 389/792] 10.222.0.93 () {56 vars in 1148 bytes} [Tue Jul 26 14:39:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:39:09.256996 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cc4381-f729-4d1f-aa08-215d581de248 None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:09.258483 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47e0e8d-9a53-4e28-aa53-25c93184fe6c None None] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:09.311240 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccf26c1-6335-4772-9a9a-86f991c57135 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:09.312265 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccf26c1-6335-4772-9a9a-86f991c57135 None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:09.312713 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccf26c1-6335-4772-9a9a-86f991c57135 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:09.313164 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccf26c1-6335-4772-9a9a-86f991c57135 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:09.334349 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccf26c1-6335-4772-9a9a-86f991c57135 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 14:39:09.342993 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application [None req-8ccf26c1-6335-4772-9a9a-86f991c57135 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 14:39:09.342993 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:39:09.342993 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:39:09.342993 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:39:09.342993 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:39:09.342993 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:39:09.342993 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:39:09.342993 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:39:09.342993 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:39:09.342993 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:39:09.342993 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:39:09.342993 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:39:09.342993 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 14:39:09.342993 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 14:39:09.342993 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 14:39:09.342993 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 14:39:09.344869 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 14:39:09.344869 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 14:39:09.344869 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 14:39:09.344869 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 14:39:09.344869 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:39:09.344869 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:39:09.344869 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:39:09.344869 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:39:09.344869 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:39:09.344869 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:39:09.344869 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:39:09.344869 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application with Lock( Jul 26 14:39:09.344869 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:39:09.344869 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:39:09.344869 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:39:09.344869 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:39:09.346570 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:39:09.346570 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:39:09.346570 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:39:09.346570 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:39:09.346570 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 14:39:09.346570 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 14:39:09.346570 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 14:39:09.346570 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 14:39:09.346570 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 14:39:09.346570 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 14:39:09.346570 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 14:39:09.346570 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Jul 26 14:39:09.346570 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 404/793] 10.222.0.93 () {56 vars in 1096 bytes} [Tue Jul 26 14:39:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:39:09.347962 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268027f7-2e34-4b12-a7c7-4ec1be8530d0 None None] REQUEST_METHOD: `POST` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:09.347962 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268027f7-2e34-4b12-a7c7-4ec1be8530d0 None None] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:09.348225 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268027f7-2e34-4b12-a7c7-4ec1be8530d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:09.376336 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.auth.core [None req-268027f7-2e34-4b12-a7c7-4ec1be8530d0 None None] MFA Rules not processed for user `e5ef88cc058f425b882bcb87a1e1e75c`. Rule list: `[]` (Enabled: `True`). {{(pid=87056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:39:09.378407 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.fernet_utils [None req-268027f7-2e34-4b12-a7c7-4ec1be8530d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:39:09.422833 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:09.434213 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cc4381-f729-4d1f-aa08-215d581de248 None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:09.472798 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:09.485128 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f248091-51f0-4a68-b7b6-efe0c2cf2d11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:09.485765 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f248091-51f0-4a68-b7b6-efe0c2cf2d11 None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:09.486053 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f248091-51f0-4a68-b7b6-efe0c2cf2d11 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:09.486362 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f248091-51f0-4a68-b7b6-efe0c2cf2d11 None admin] PATH_INFO: `/v3/services` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:09.487076 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f248091-51f0-4a68-b7b6-efe0c2cf2d11 None admin] RBAC: Adding query filter params (type=network) {{(pid=87055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:39:09.488230 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f248091-51f0-4a68-b7b6-efe0c2cf2d11 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:09.488798 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f248091-51f0-4a68-b7b6-efe0c2cf2d11 None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:09.492977 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 405/794] 10.222.0.93 () {58 vars in 1023 bytes} [Tue Jul 26 14:39:09 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 14:39:09.494632 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268027f7-2e34-4b12-a7c7-4ec1be8530d0 None None] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:09.506213 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 390/795] 10.222.0.93 () {56 vars in 1112 bytes} [Tue Jul 26 14:39:09 2022] GET /identity/v3/services?type=network => generated 350 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:39:09.508259 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f248091-51f0-4a68-b7b6-efe0c2cf2d11 None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:09.641433 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f248091-51f0-4a68-b7b6-efe0c2cf2d11 None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:09.672412 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268027f7-2e34-4b12-a7c7-4ec1be8530d0 None None] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:09.704365 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca715e90-d1eb-42fd-af04-c392aad5993c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:09.705328 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca715e90-d1eb-42fd-af04-c392aad5993c None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:09.705790 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca715e90-d1eb-42fd-af04-c392aad5993c None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:09.706618 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca715e90-d1eb-42fd-af04-c392aad5993c None admin] PATH_INFO: `/v3/roles` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:09.707797 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca715e90-d1eb-42fd-af04-c392aad5993c None admin] RBAC: Adding query filter params (name=admin) {{(pid=87055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:39:09.708857 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca715e90-d1eb-42fd-af04-c392aad5993c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:09.711110 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca715e90-d1eb-42fd-af04-c392aad5993c None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:09.731609 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 391/796] 10.222.0.93 () {56 vars in 1099 bytes} [Tue Jul 26 14:39:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:39:09.731609 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca715e90-d1eb-42fd-af04-c392aad5993c None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:09.744038 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c769c8-87c6-4ec9-a70c-313796e7d38b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:09.744468 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c769c8-87c6-4ec9-a70c-313796e7d38b None admin] REQUEST_METHOD: `PUT` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:09.745003 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c769c8-87c6-4ec9-a70c-313796e7d38b None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:09.745539 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c769c8-87c6-4ec9-a70c-313796e7d38b None admin] PATH_INFO: `/v3/projects/c422a2290a14424da20e2841cbc1741d/users/0205dfcfb5e5404c95aefc1f45a1e1e6/roles/2e45ca312cda4bef9263725ae1c6dab7` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:09.768026 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:09.771860 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c769c8-87c6-4ec9-a70c-313796e7d38b None admin] RBAC: Authorizing `identity:create_grant(project_id=c422a2290a14424da20e2841cbc1741d, user_id=0205dfcfb5e5404c95aefc1f45a1e1e6, role_id=2e45ca312cda4bef9263725ae1c6dab7)` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:09.774424 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c769c8-87c6-4ec9-a70c-313796e7d38b None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:09.864803 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca715e90-d1eb-42fd-af04-c392aad5993c None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:09.898391 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 406/797] 10.222.0.93 () {58 vars in 1439 bytes} [Tue Jul 26 14:39:09 2022] PUT /identity/v3/projects/c422a2290a14424da20e2841cbc1741d/users/0205dfcfb5e5404c95aefc1f45a1e1e6/roles/2e45ca312cda4bef9263725ae1c6dab7 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 14:39:09.898391 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c769c8-87c6-4ec9-a70c-313796e7d38b None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:09.923168 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fd69dd-4ce7-4dcf-8427-4f520c18f76d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:09.924460 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fd69dd-4ce7-4dcf-8427-4f520c18f76d None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:09.925099 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fd69dd-4ce7-4dcf-8427-4f520c18f76d None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:09.925722 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fd69dd-4ce7-4dcf-8427-4f520c18f76d None admin] PATH_INFO: `/v3/endpoints` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:09.927736 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fd69dd-4ce7-4dcf-8427-4f520c18f76d None admin] RBAC: Adding query filter params (interface=public, service_id=94514d6fa8db46d084242cbade758503, region_id=RegionOne) {{(pid=87055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:39:09.928325 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fd69dd-4ce7-4dcf-8427-4f520c18f76d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:09.931041 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fd69dd-4ce7-4dcf-8427-4f520c18f76d None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:09.944272 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 392/798] 10.222.0.93 () {56 vars in 1251 bytes} [Tue Jul 26 14:39:09 2022] GET /identity/v3/endpoints?service_id=94514d6fa8db46d084242cbade758503&interface=public®ion_id=RegionOne => generated 194 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:39:09.945317 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fd69dd-4ce7-4dcf-8427-4f520c18f76d None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:09.970765 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:10.111174 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:10.120856 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c769c8-87c6-4ec9-a70c-313796e7d38b None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:10.147862 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fd69dd-4ce7-4dcf-8427-4f520c18f76d None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:10.181888 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd16b3b-7e93-47db-9755-ef1538001c00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:10.182527 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd16b3b-7e93-47db-9755-ef1538001c00 None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:10.182823 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd16b3b-7e93-47db-9755-ef1538001c00 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:10.183105 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd16b3b-7e93-47db-9755-ef1538001c00 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:10.199792 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd16b3b-7e93-47db-9755-ef1538001c00 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 14:39:10.206285 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application [None req-9bd16b3b-7e93-47db-9755-ef1538001c00 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 14:39:10.206285 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:39:10.206285 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:39:10.206285 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:39:10.206285 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:39:10.206285 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:39:10.206285 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:39:10.206285 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:39:10.206285 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:39:10.206285 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:39:10.206285 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:39:10.206285 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:39:10.206285 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 14:39:10.206285 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 14:39:10.206285 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 14:39:10.206285 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 14:39:10.208155 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 14:39:10.208155 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 14:39:10.208155 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 14:39:10.208155 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 14:39:10.208155 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:39:10.208155 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:39:10.208155 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:39:10.208155 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:39:10.208155 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:39:10.208155 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:39:10.208155 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:39:10.208155 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application with Lock( Jul 26 14:39:10.208155 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:39:10.208155 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:39:10.208155 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:39:10.208155 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:39:10.209791 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:39:10.209791 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:39:10.209791 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:39:10.209791 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:39:10.209791 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 14:39:10.209791 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 14:39:10.209791 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 14:39:10.209791 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 14:39:10.209791 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 14:39:10.209791 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 14:39:10.209791 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 14:39:10.209791 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Jul 26 14:39:10.209791 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 407/799] 10.222.0.93 () {56 vars in 1096 bytes} [Tue Jul 26 14:39:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 321 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:39:10.209791 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd16b3b-7e93-47db-9755-ef1538001c00 None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:10.222308 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39f917c-37cf-4fb7-890b-c93a21423237 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:10.224115 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39f917c-37cf-4fb7-890b-c93a21423237 None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:10.224626 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39f917c-37cf-4fb7-890b-c93a21423237 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:10.225225 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39f917c-37cf-4fb7-890b-c93a21423237 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:10.247004 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39f917c-37cf-4fb7-890b-c93a21423237 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:10.249927 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39f917c-37cf-4fb7-890b-c93a21423237 None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:10.282483 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application [None req-f39f917c-37cf-4fb7-890b-c93a21423237 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:39:10.282483 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:39:10.282483 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:39:10.282483 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:39:10.282483 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:39:10.282483 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:39:10.282483 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:39:10.282483 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:39:10.282483 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:39:10.282483 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:39:10.282483 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:39:10.282483 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:39:10.282483 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 14:39:10.282483 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 14:39:10.282483 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 14:39:10.285125 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 14:39:10.285125 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:39:10.285125 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:39:10.285125 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:39:10.285125 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:39:10.285125 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:39:10.285125 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:39:10.285125 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:39:10.285125 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application with Lock( Jul 26 14:39:10.285125 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:39:10.285125 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:39:10.285125 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:39:10.285125 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:39:10.285125 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:39:10.285125 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:39:10.285125 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:39:10.285125 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:39:10.288291 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 14:39:10.288291 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 14:39:10.288291 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:39:10.288291 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Jul 26 14:39:10.288291 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 393/800] 10.222.0.93 () {56 vars in 1108 bytes} [Tue Jul 26 14:39:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 341 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:39:10.288291 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39f917c-37cf-4fb7-890b-c93a21423237 None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:10.359556 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:10.372258 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd16b3b-7e93-47db-9755-ef1538001c00 None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:10.447409 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402d42e8-d609-43d8-9be6-71f63e4e3b50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:10.448264 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402d42e8-d609-43d8-9be6-71f63e4e3b50 None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:10.448778 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402d42e8-d609-43d8-9be6-71f63e4e3b50 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:10.449320 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402d42e8-d609-43d8-9be6-71f63e4e3b50 None admin] PATH_INFO: `/v3/services` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:10.450538 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402d42e8-d609-43d8-9be6-71f63e4e3b50 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:10.452669 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402d42e8-d609-43d8-9be6-71f63e4e3b50 None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:10.456885 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39f917c-37cf-4fb7-890b-c93a21423237 None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:10.466961 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 408/801] 10.222.0.93 () {56 vars in 1087 bytes} [Tue Jul 26 14:39:10 2022] GET /identity/v3/services => generated 772 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:39:10.466961 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402d42e8-d609-43d8-9be6-71f63e4e3b50 None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:10.502832 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab96c2e2-b878-4ca4-b28f-32b86fdfe950 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:10.503775 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab96c2e2-b878-4ca4-b28f-32b86fdfe950 None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:10.504229 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab96c2e2-b878-4ca4-b28f-32b86fdfe950 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:10.504683 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab96c2e2-b878-4ca4-b28f-32b86fdfe950 None admin] PATH_INFO: `/v3/roles` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:10.506608 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab96c2e2-b878-4ca4-b28f-32b86fdfe950 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:39:10.507102 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab96c2e2-b878-4ca4-b28f-32b86fdfe950 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:10.508718 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab96c2e2-b878-4ca4-b28f-32b86fdfe950 None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:10.511838 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:10.521253 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 394/802] 10.222.0.93 () {56 vars in 1099 bytes} [Tue Jul 26 14:39:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:39:10.523061 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a1946d-5be8-47c7-9a49-35e402ca5c17 None None] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:10.524556 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a1946d-5be8-47c7-9a49-35e402ca5c17 None None] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:10.524556 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a1946d-5be8-47c7-9a49-35e402ca5c17 None None] PATH_INFO: `/` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:10.526151 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 395/803] 10.222.0.93 () {54 vars in 926 bytes} [Tue Jul 26 14:39:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:39:10.527320 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a1946d-5be8-47c7-9a49-35e402ca5c17 None None] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:10.645068 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402d42e8-d609-43d8-9be6-71f63e4e3b50 None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:10.705012 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3623b65-d689-4d92-be63-baed09e3872a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:10.705550 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3623b65-d689-4d92-be63-baed09e3872a None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:10.705831 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3623b65-d689-4d92-be63-baed09e3872a None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:10.706109 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3623b65-d689-4d92-be63-baed09e3872a None admin] PATH_INFO: `/v3/domains` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:10.706935 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3623b65-d689-4d92-be63-baed09e3872a None admin] RBAC: Adding query filter params (name=Default) {{(pid=87056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:39:10.707243 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3623b65-d689-4d92-be63-baed09e3872a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:10.709222 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3623b65-d689-4d92-be63-baed09e3872a None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:10.710004 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a1946d-5be8-47c7-9a49-35e402ca5c17 None None] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:10.726095 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 409/804] 10.222.0.93 () {56 vars in 1109 bytes} [Tue Jul 26 14:39:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:39:10.727431 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe26ef0-c8ae-44b1-81a9-b1853ce70c8d None None] REQUEST_METHOD: `POST` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:10.727721 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe26ef0-c8ae-44b1-81a9-b1853ce70c8d None None] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:10.728000 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe26ef0-c8ae-44b1-81a9-b1853ce70c8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:10.757854 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a78f351-4b24-4c36-bde1-d97c138cc260 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:10.758715 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a78f351-4b24-4c36-bde1-d97c138cc260 None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:10.759011 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a78f351-4b24-4c36-bde1-d97c138cc260 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:10.759342 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a78f351-4b24-4c36-bde1-d97c138cc260 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:10.760386 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.auth.core [None req-1fe26ef0-c8ae-44b1-81a9-b1853ce70c8d None None] MFA Rules not processed for user `e5ef88cc058f425b882bcb87a1e1e75c`. Rule list: `[]` (Enabled: `True`). {{(pid=87056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:39:10.762165 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.fernet_utils [None req-1fe26ef0-c8ae-44b1-81a9-b1853ce70c8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:39:10.772828 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a78f351-4b24-4c36-bde1-d97c138cc260 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:10.774887 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a78f351-4b24-4c36-bde1-d97c138cc260 None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:10.784166 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:10.792275 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application [None req-2a78f351-4b24-4c36-bde1-d97c138cc260 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:39:10.792275 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:39:10.792275 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:39:10.792275 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:39:10.792275 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:39:10.792275 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:39:10.792275 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:39:10.792275 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:39:10.792275 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:39:10.792275 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:39:10.792275 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:39:10.792275 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:39:10.792275 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 14:39:10.792275 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 14:39:10.792275 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 14:39:10.793355 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 14:39:10.793355 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:39:10.793355 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:39:10.793355 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:39:10.793355 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:39:10.793355 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:39:10.793355 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:39:10.793355 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:39:10.793355 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application with Lock( Jul 26 14:39:10.793355 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:39:10.793355 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:39:10.793355 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:39:10.793355 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:39:10.793355 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:39:10.793355 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:39:10.793355 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:39:10.793355 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:39:10.794509 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 14:39:10.794509 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 14:39:10.794509 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:39:10.794509 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Jul 26 14:39:10.796122 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 396/805] 10.222.0.93 () {56 vars in 1108 bytes} [Tue Jul 26 14:39:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:39:10.798867 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a78f351-4b24-4c36-bde1-d97c138cc260 None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:10.859497 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 410/806] 10.222.0.93 () {58 vars in 1023 bytes} [Tue Jul 26 14:39:10 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 14:39:10.860617 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe26ef0-c8ae-44b1-81a9-b1853ce70c8d None None] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:10.877325 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:10.961284 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a78f351-4b24-4c36-bde1-d97c138cc260 None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:11.005867 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe26ef0-c8ae-44b1-81a9-b1853ce70c8d None None] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:11.006368 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06bfbbd-0dfa-43d7-86f9-864eacf5c282 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:11.007390 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06bfbbd-0dfa-43d7-86f9-864eacf5c282 None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:11.007837 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06bfbbd-0dfa-43d7-86f9-864eacf5c282 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:11.008261 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06bfbbd-0dfa-43d7-86f9-864eacf5c282 None admin] PATH_INFO: `/v3/users/swift` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:11.017740 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06bfbbd-0dfa-43d7-86f9-864eacf5c282 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:11.019562 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06bfbbd-0dfa-43d7-86f9-864eacf5c282 None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:11.033506 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application [None req-e06bfbbd-0dfa-43d7-86f9-864eacf5c282 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 26 14:39:11.033506 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:39:11.033506 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:39:11.033506 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:39:11.033506 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:39:11.033506 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:39:11.033506 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:39:11.033506 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:39:11.033506 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:39:11.033506 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:39:11.033506 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:39:11.033506 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:39:11.033506 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 14:39:11.033506 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 14:39:11.033506 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 14:39:11.033506 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 14:39:11.034576 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:39:11.034576 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:39:11.034576 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 14:39:11.034576 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 14:39:11.034576 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 14:39:11.034576 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 14:39:11.034576 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:39:11.034576 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:39:11.034576 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:39:11.034576 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:39:11.034576 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:39:11.034576 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application with Lock( Jul 26 14:39:11.034576 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:39:11.034576 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:39:11.034576 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:39:11.034576 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:39:11.034576 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:39:11.034576 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:39:11.035503 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:39:11.035503 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:39:11.035503 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 14:39:11.035503 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 14:39:11.035503 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 14:39:11.035503 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 14:39:11.035503 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 14:39:11.035503 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 14:39:11.035503 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 26 14:39:11.035503 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Jul 26 14:39:11.042866 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 397/807] 10.222.0.93 () {56 vars in 1096 bytes} [Tue Jul 26 14:39:10 2022] GET /identity/v3/users/swift => generated 83 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:39:11.044167 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06bfbbd-0dfa-43d7-86f9-864eacf5c282 None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:11.050793 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a2bd41-52d4-4d81-b6ed-77c5f09f22bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:11.052264 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a2bd41-52d4-4d81-b6ed-77c5f09f22bd None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:11.052656 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a2bd41-52d4-4d81-b6ed-77c5f09f22bd None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:11.053023 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a2bd41-52d4-4d81-b6ed-77c5f09f22bd None admin] PATH_INFO: `/v3/domains` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:11.053886 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a2bd41-52d4-4d81-b6ed-77c5f09f22bd None admin] RBAC: Adding query filter params (name=Default) {{(pid=87056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:39:11.054279 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a2bd41-52d4-4d81-b6ed-77c5f09f22bd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:11.055943 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a2bd41-52d4-4d81-b6ed-77c5f09f22bd None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:11.070902 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 411/808] 10.222.0.93 () {56 vars in 1109 bytes} [Tue Jul 26 14:39:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:39:11.071713 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a2bd41-52d4-4d81-b6ed-77c5f09f22bd None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:11.087049 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:11.188192 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06bfbbd-0dfa-43d7-86f9-864eacf5c282 None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:11.200758 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:11.215995 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a2bd41-52d4-4d81-b6ed-77c5f09f22bd None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:11.231502 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3b4405-6796-4dc3-b690-50e6e31abbef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:11.232512 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3b4405-6796-4dc3-b690-50e6e31abbef None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:11.233128 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3b4405-6796-4dc3-b690-50e6e31abbef None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:11.234031 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3b4405-6796-4dc3-b690-50e6e31abbef None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:11.234942 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3b4405-6796-4dc3-b690-50e6e31abbef None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:11.236555 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3b4405-6796-4dc3-b690-50e6e31abbef None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:11.250114 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application [None req-9a3b4405-6796-4dc3-b690-50e6e31abbef None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 26 14:39:11.250114 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:39:11.250114 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 14:39:11.250114 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 14:39:11.250114 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 14:39:11.250114 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 14:39:11.250114 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 14:39:11.250114 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 14:39:11.250114 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 26 14:39:11.250114 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Jul 26 14:39:11.250114 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 14:39:11.250114 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Jul 26 14:39:11.250114 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:39:11.250114 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:39:11.250114 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:39:11.250114 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:39:11.251234 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:39:11.251234 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:39:11.251234 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:39:11.251234 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:39:11.251234 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:39:11.251234 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:39:11.251234 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:39:11.251234 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 14:39:11.251234 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 14:39:11.251234 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 14:39:11.251234 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 14:39:11.251234 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:39:11.251234 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:39:11.251234 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:39:11.251234 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:39:11.251234 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:39:11.252193 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:39:11.252193 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:39:11.252193 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application with Lock( Jul 26 14:39:11.252193 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:39:11.252193 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:39:11.252193 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:39:11.252193 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:39:11.252193 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:39:11.252193 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:39:11.252193 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:39:11.252193 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:39:11.252193 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 14:39:11.252193 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 14:39:11.252193 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 26 14:39:11.252193 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Jul 26 14:39:11.256074 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 398/809] 10.222.0.93 () {56 vars in 1129 bytes} [Tue Jul 26 14:39:11 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:39:11.257929 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3b4405-6796-4dc3-b690-50e6e31abbef None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:11.267036 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c608d00-e0f4-4983-95da-0032c26d2e40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:11.267813 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c608d00-e0f4-4983-95da-0032c26d2e40 None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:11.268097 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c608d00-e0f4-4983-95da-0032c26d2e40 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:11.268373 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c608d00-e0f4-4983-95da-0032c26d2e40 None admin] PATH_INFO: `/v3/users` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:11.269192 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c608d00-e0f4-4983-95da-0032c26d2e40 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=87056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:39:11.269505 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c608d00-e0f4-4983-95da-0032c26d2e40 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:11.272743 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c608d00-e0f4-4983-95da-0032c26d2e40 None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:11.304984 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 412/810] 10.222.0.93 () {56 vars in 1135 bytes} [Tue Jul 26 14:39:11 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:39:11.304984 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c608d00-e0f4-4983-95da-0032c26d2e40 None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:11.410670 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:11.416080 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3b4405-6796-4dc3-b690-50e6e31abbef None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:11.438044 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c608d00-e0f4-4983-95da-0032c26d2e40 None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:11.462515 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4394c602-3900-4576-be37-17b73c08d56b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:11.463724 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4394c602-3900-4576-be37-17b73c08d56b None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:11.464184 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4394c602-3900-4576-be37-17b73c08d56b None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:11.464623 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4394c602-3900-4576-be37-17b73c08d56b None admin] PATH_INFO: `/v3/users/nova` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:11.476244 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4394c602-3900-4576-be37-17b73c08d56b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:11.479293 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4394c602-3900-4576-be37-17b73c08d56b None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:11.487401 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139c4da6-d194-4fb8-ab75-61dee0239f83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:11.488185 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139c4da6-d194-4fb8-ab75-61dee0239f83 None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:11.488558 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139c4da6-d194-4fb8-ab75-61dee0239f83 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:11.488938 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139c4da6-d194-4fb8-ab75-61dee0239f83 None admin] PATH_INFO: `/v3/services` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:11.490001 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139c4da6-d194-4fb8-ab75-61dee0239f83 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=87056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:39:11.490519 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139c4da6-d194-4fb8-ab75-61dee0239f83 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:11.492207 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139c4da6-d194-4fb8-ab75-61dee0239f83 None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:11.496867 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application [None req-4394c602-3900-4576-be37-17b73c08d56b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 26 14:39:11.496867 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:39:11.496867 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:39:11.496867 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:39:11.496867 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:39:11.496867 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:39:11.496867 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:39:11.496867 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:39:11.496867 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:39:11.496867 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:39:11.496867 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:39:11.496867 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:39:11.496867 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 14:39:11.496867 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 14:39:11.496867 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 14:39:11.496867 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 14:39:11.498016 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:39:11.498016 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:39:11.498016 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 14:39:11.498016 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 14:39:11.498016 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 14:39:11.498016 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 14:39:11.498016 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:39:11.498016 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:39:11.498016 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:39:11.498016 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:39:11.498016 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:39:11.498016 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application with Lock( Jul 26 14:39:11.498016 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:39:11.498016 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:39:11.498016 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:39:11.498016 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:39:11.498016 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:39:11.498016 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:39:11.499197 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:39:11.499197 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:39:11.499197 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 14:39:11.499197 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 14:39:11.499197 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 14:39:11.499197 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 14:39:11.499197 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 14:39:11.499197 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 14:39:11.499197 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 26 14:39:11.499197 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Jul 26 14:39:11.500590 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 413/811] 10.222.0.93 () {56 vars in 1124 bytes} [Tue Jul 26 14:39:11 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:39:11.501573 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 399/812] 10.222.0.93 () {56 vars in 1093 bytes} [Tue Jul 26 14:39:11 2022] GET /identity/v3/users/nova => generated 82 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:39:11.501750 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139c4da6-d194-4fb8-ab75-61dee0239f83 None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:11.508862 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4394c602-3900-4576-be37-17b73c08d56b None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:11.557253 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:11.649018 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139c4da6-d194-4fb8-ab75-61dee0239f83 None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:11.652960 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4394c602-3900-4576-be37-17b73c08d56b None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:11.693699 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:11.699190 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d356d736-3adb-44c0-a292-b2722f1c2912 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:11.699664 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278fe39a-cda4-47af-bb63-0668e8ada221 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:11.700282 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d356d736-3adb-44c0-a292-b2722f1c2912 None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:11.700398 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278fe39a-cda4-47af-bb63-0668e8ada221 None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:11.700583 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278fe39a-cda4-47af-bb63-0668e8ada221 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:11.700856 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278fe39a-cda4-47af-bb63-0668e8ada221 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:11.701103 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d356d736-3adb-44c0-a292-b2722f1c2912 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:11.701872 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d356d736-3adb-44c0-a292-b2722f1c2912 None admin] PATH_INFO: `/v3/services` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:11.702782 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d356d736-3adb-44c0-a292-b2722f1c2912 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=87055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:39:11.708600 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d356d736-3adb-44c0-a292-b2722f1c2912 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:11.708600 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d356d736-3adb-44c0-a292-b2722f1c2912 None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:11.712426 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 400/813] 10.222.0.93 () {56 vars in 1124 bytes} [Tue Jul 26 14:39:11 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:39:11.715266 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d356d736-3adb-44c0-a292-b2722f1c2912 None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:11.721323 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278fe39a-cda4-47af-bb63-0668e8ada221 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:11.722917 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278fe39a-cda4-47af-bb63-0668e8ada221 None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:11.748417 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application [None req-278fe39a-cda4-47af-bb63-0668e8ada221 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:39:11.748417 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:39:11.748417 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:39:11.748417 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:39:11.748417 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:39:11.748417 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:39:11.748417 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:39:11.748417 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:39:11.748417 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:39:11.748417 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:39:11.748417 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:39:11.748417 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:39:11.748417 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 14:39:11.748417 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 14:39:11.748417 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 14:39:11.750043 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 14:39:11.750043 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:39:11.750043 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:39:11.750043 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:39:11.750043 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:39:11.750043 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:39:11.750043 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:39:11.750043 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:39:11.750043 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application with Lock( Jul 26 14:39:11.750043 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:39:11.750043 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:39:11.750043 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:39:11.750043 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:39:11.750043 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:39:11.750043 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:39:11.750043 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:39:11.750043 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:39:11.752265 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 14:39:11.752265 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 14:39:11.752265 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:39:11.752265 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Jul 26 14:39:11.752265 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 414/814] 10.222.0.93 () {56 vars in 1108 bytes} [Tue Jul 26 14:39:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:39:11.752265 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278fe39a-cda4-47af-bb63-0668e8ada221 None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:11.883463 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278fe39a-cda4-47af-bb63-0668e8ada221 None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:11.919989 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:11.926779 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26314b02-fae2-4628-bb94-011188592b4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:11.928157 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26314b02-fae2-4628-bb94-011188592b4f None admin] REQUEST_METHOD: `POST` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:11.928436 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26314b02-fae2-4628-bb94-011188592b4f None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:11.928748 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26314b02-fae2-4628-bb94-011188592b4f None admin] PATH_INFO: `/v3/endpoints` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:11.936777 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26314b02-fae2-4628-bb94-011188592b4f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:11.936958 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d356d736-3adb-44c0-a292-b2722f1c2912 None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:11.937096 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26314b02-fae2-4628-bb94-011188592b4f None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:11.993517 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a6b8e1-aada-4f08-bb3c-55dfab9a51ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:11.994146 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a6b8e1-aada-4f08-bb3c-55dfab9a51ea None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:11.994461 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a6b8e1-aada-4f08-bb3c-55dfab9a51ea None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:11.994741 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a6b8e1-aada-4f08-bb3c-55dfab9a51ea None admin] PATH_INFO: `/v3/users` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:11.995551 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a6b8e1-aada-4f08-bb3c-55dfab9a51ea None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:39:11.995860 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a6b8e1-aada-4f08-bb3c-55dfab9a51ea None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:11.997367 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a6b8e1-aada-4f08-bb3c-55dfab9a51ea None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:12.034386 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 401/815] 10.222.0.93 () {56 vars in 1133 bytes} [Tue Jul 26 14:39:11 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:39:12.034386 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a6b8e1-aada-4f08-bb3c-55dfab9a51ea None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:12.158669 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 415/816] 10.222.0.93 () {60 vars in 1144 bytes} [Tue Jul 26 14:39:11 2022] POST /identity/v3/endpoints => generated 346 bytes in 400 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 14:39:12.160152 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26314b02-fae2-4628-bb94-011188592b4f None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:12.228142 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a6b8e1-aada-4f08-bb3c-55dfab9a51ea None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:12.287287 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:12.338530 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901d4f39-a71f-40fb-b521-526f966885ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:12.340180 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901d4f39-a71f-40fb-b521-526f966885ac None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:12.340999 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901d4f39-a71f-40fb-b521-526f966885ac None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:12.341769 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901d4f39-a71f-40fb-b521-526f966885ac None admin] PATH_INFO: `/v3/domains` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:12.344360 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901d4f39-a71f-40fb-b521-526f966885ac None admin] RBAC: Adding query filter params (name=Default) {{(pid=87055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:39:12.345447 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901d4f39-a71f-40fb-b521-526f966885ac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:12.348684 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901d4f39-a71f-40fb-b521-526f966885ac None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:12.376721 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 402/817] 10.222.0.93 () {56 vars in 1109 bytes} [Tue Jul 26 14:39:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 349 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:39:12.384468 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901d4f39-a71f-40fb-b521-526f966885ac None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:12.423467 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:12.496824 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26314b02-fae2-4628-bb94-011188592b4f None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:12.576137 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68aafb5c-3fff-4533-ac1e-73b147ebce01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:12.577152 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68aafb5c-3fff-4533-ac1e-73b147ebce01 None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:12.577631 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68aafb5c-3fff-4533-ac1e-73b147ebce01 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:12.578089 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68aafb5c-3fff-4533-ac1e-73b147ebce01 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:12.647961 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901d4f39-a71f-40fb-b521-526f966885ac None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:12.740017 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208629ff-c3df-40ff-90b5-0f9138b9415b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:12.740839 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208629ff-c3df-40ff-90b5-0f9138b9415b None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:12.741315 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208629ff-c3df-40ff-90b5-0f9138b9415b None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:12.741779 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208629ff-c3df-40ff-90b5-0f9138b9415b None admin] PATH_INFO: `/v3/projects/service` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:12.756278 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208629ff-c3df-40ff-90b5-0f9138b9415b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:12.759141 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208629ff-c3df-40ff-90b5-0f9138b9415b None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:12.764505 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68aafb5c-3fff-4533-ac1e-73b147ebce01 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:12.767818 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68aafb5c-3fff-4533-ac1e-73b147ebce01 None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:12.784704 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application [None req-208629ff-c3df-40ff-90b5-0f9138b9415b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 14:39:12.784704 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:39:12.784704 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:39:12.784704 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:39:12.784704 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:39:12.784704 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:39:12.784704 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:39:12.784704 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:39:12.784704 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:39:12.784704 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:39:12.784704 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:39:12.784704 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:39:12.784704 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 14:39:12.784704 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 14:39:12.784704 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 14:39:12.787561 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 14:39:12.787561 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:39:12.787561 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:39:12.787561 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:39:12.787561 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:39:12.787561 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:39:12.787561 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:39:12.787561 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:39:12.787561 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application with Lock( Jul 26 14:39:12.787561 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:39:12.787561 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:39:12.787561 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:39:12.787561 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:39:12.787561 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:39:12.787561 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:39:12.787561 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:39:12.787561 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:39:12.789488 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 14:39:12.789488 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 14:39:12.789488 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 14:39:12.789488 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 14:39:12.789488 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 14:39:12.789488 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 14:39:12.789488 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 14:39:12.789488 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Jul 26 14:39:12.789488 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 403/818] 10.222.0.93 () {56 vars in 1111 bytes} [Tue Jul 26 14:39:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 405 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 14:39:12.791226 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af28ee3-ac69-432d-93ff-2dcebcf2c7ac None None] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:12.791226 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af28ee3-ac69-432d-93ff-2dcebcf2c7ac None None] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:12.791695 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af28ee3-ac69-432d-93ff-2dcebcf2c7ac None None] PATH_INFO: `/` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:12.794511 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 404/819] 10.222.0.93 () {54 vars in 926 bytes} [Tue Jul 26 14:39:12 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:39:12.796025 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af28ee3-ac69-432d-93ff-2dcebcf2c7ac None None] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:12.894662 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:12.934682 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:12.972179 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af28ee3-ac69-432d-93ff-2dcebcf2c7ac None None] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:13.000108 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 416/820] 10.222.0.93 () {58 vars in 1282 bytes} [Tue Jul 26 14:39:12 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 841 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 26 14:39:13.003949 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9824c7-ff35-4ee7-8088-4f70516cdf20 None None] REQUEST_METHOD: `POST` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:13.005912 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9824c7-ff35-4ee7-8088-4f70516cdf20 None None] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:13.006744 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9824c7-ff35-4ee7-8088-4f70516cdf20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:13.030271 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.auth.core [None req-9f9824c7-ff35-4ee7-8088-4f70516cdf20 None None] MFA Rules not processed for user `e5ef88cc058f425b882bcb87a1e1e75c`. Rule list: `[]` (Enabled: `True`). {{(pid=87056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:39:13.030838 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2ee905-717f-4591-8d10-bdf61a14d5a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:13.032081 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.fernet_utils [None req-9f9824c7-ff35-4ee7-8088-4f70516cdf20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:39:13.032266 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2ee905-717f-4591-8d10-bdf61a14d5a2 None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:13.032647 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2ee905-717f-4591-8d10-bdf61a14d5a2 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:13.033149 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2ee905-717f-4591-8d10-bdf61a14d5a2 None admin] PATH_INFO: `/v3/projects` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:13.034661 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2ee905-717f-4591-8d10-bdf61a14d5a2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:39:13.035329 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2ee905-717f-4591-8d10-bdf61a14d5a2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:13.038353 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2ee905-717f-4591-8d10-bdf61a14d5a2 None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:13.061831 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 405/821] 10.222.0.93 () {56 vars in 1148 bytes} [Tue Jul 26 14:39:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:39:13.064770 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d777fb-4a66-4b17-81af-ba6020afab04 None None] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:13.065353 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d777fb-4a66-4b17-81af-ba6020afab04 None None] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:13.065847 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d777fb-4a66-4b17-81af-ba6020afab04 None None] PATH_INFO: `/` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:13.072290 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 406/822] 10.222.0.93 () {54 vars in 926 bytes} [Tue Jul 26 14:39:13 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:39:13.073260 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d777fb-4a66-4b17-81af-ba6020afab04 None None] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:13.160102 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 417/823] 10.222.0.93 () {58 vars in 1023 bytes} [Tue Jul 26 14:39:13 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 14:39:13.162095 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9824c7-ff35-4ee7-8088-4f70516cdf20 None None] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:13.268170 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d777fb-4a66-4b17-81af-ba6020afab04 None None] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:13.275869 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:13.328773 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9824c7-ff35-4ee7-8088-4f70516cdf20 None None] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:13.329848 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:13.338080 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23383285-eaeb-460b-86f5-3733884a86b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:13.339433 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23383285-eaeb-460b-86f5-3733884a86b3 None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:13.339932 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23383285-eaeb-460b-86f5-3733884a86b3 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:13.340424 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23383285-eaeb-460b-86f5-3733884a86b3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:13.360062 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23383285-eaeb-460b-86f5-3733884a86b3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:13.362946 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23383285-eaeb-460b-86f5-3733884a86b3 None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:13.391134 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application [None req-23383285-eaeb-460b-86f5-3733884a86b3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:39:13.391134 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:39:13.391134 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:39:13.391134 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:39:13.391134 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:39:13.391134 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:39:13.391134 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:39:13.391134 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:39:13.391134 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:39:13.391134 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:39:13.391134 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:39:13.391134 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:39:13.391134 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 14:39:13.391134 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 14:39:13.391134 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 14:39:13.392110 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 14:39:13.392110 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:39:13.392110 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:39:13.392110 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:39:13.392110 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:39:13.392110 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:39:13.392110 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:39:13.392110 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:39:13.392110 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application with Lock( Jul 26 14:39:13.392110 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:39:13.392110 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:39:13.392110 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:39:13.392110 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:39:13.392110 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:39:13.392110 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:39:13.392110 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:39:13.392110 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:39:13.392980 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 14:39:13.392980 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 14:39:13.392980 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:39:13.392980 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Jul 26 14:39:13.400878 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 407/824] 10.222.0.93 () {56 vars in 1108 bytes} [Tue Jul 26 14:39:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 328 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:39:13.402610 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b956f0-d666-41e6-897c-60585eedef01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:13.403430 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b956f0-d666-41e6-897c-60585eedef01 None admin] REQUEST_METHOD: `PUT` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:13.403600 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2899c340-d744-444e-bdb7-3d5865933110 None None] REQUEST_METHOD: `POST` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:13.403766 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b956f0-d666-41e6-897c-60585eedef01 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:13.403898 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2899c340-d744-444e-bdb7-3d5865933110 None None] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:13.404015 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b956f0-d666-41e6-897c-60585eedef01 None admin] PATH_INFO: `/v3/projects/c422a2290a14424da20e2841cbc1741d/users/b914b2ba87e74def85f9694e1141e00b/roles/94e105ff8ee4486abd501415cc05ba38` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:13.404404 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2899c340-d744-444e-bdb7-3d5865933110 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:13.406789 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b956f0-d666-41e6-897c-60585eedef01 None admin] RBAC: Authorizing `identity:create_grant(project_id=c422a2290a14424da20e2841cbc1741d, user_id=b914b2ba87e74def85f9694e1141e00b, role_id=94e105ff8ee4486abd501415cc05ba38)` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:13.408245 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b956f0-d666-41e6-897c-60585eedef01 None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:13.429934 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.auth.core [None req-2899c340-d744-444e-bdb7-3d5865933110 None None] MFA Rules not processed for user `e5ef88cc058f425b882bcb87a1e1e75c`. Rule list: `[]` (Enabled: `True`). {{(pid=87055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:39:13.431111 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.fernet_utils [None req-2899c340-d744-444e-bdb7-3d5865933110 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:39:13.476468 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 418/825] 10.222.0.93 () {58 vars in 1439 bytes} [Tue Jul 26 14:39:13 2022] PUT /identity/v3/projects/c422a2290a14424da20e2841cbc1741d/users/b914b2ba87e74def85f9694e1141e00b/roles/94e105ff8ee4486abd501415cc05ba38 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 14:39:13.478205 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b956f0-d666-41e6-897c-60585eedef01 None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:13.559899 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 408/826] 10.222.0.93 () {58 vars in 1023 bytes} [Tue Jul 26 14:39:13 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 14:39:13.561732 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2899c340-d744-444e-bdb7-3d5865933110 None None] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:13.692912 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b956f0-d666-41e6-897c-60585eedef01 None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:13.757621 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:13.767898 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7893e02-08b4-45ae-8dfe-c741d10b8279 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:13.769020 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7893e02-08b4-45ae-8dfe-c741d10b8279 None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:13.769500 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7893e02-08b4-45ae-8dfe-c741d10b8279 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:13.770100 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7893e02-08b4-45ae-8dfe-c741d10b8279 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:13.782685 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2899c340-d744-444e-bdb7-3d5865933110 None None] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:13.794124 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7893e02-08b4-45ae-8dfe-c741d10b8279 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 14:39:13.800319 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application [None req-b7893e02-08b4-45ae-8dfe-c741d10b8279 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 26 14:39:13.800319 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:39:13.800319 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:39:13.800319 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:39:13.800319 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:39:13.800319 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:39:13.800319 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:39:13.800319 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:39:13.800319 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:39:13.800319 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:39:13.800319 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:39:13.800319 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:39:13.800319 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 14:39:13.800319 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 14:39:13.800319 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 14:39:13.800319 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 14:39:13.801333 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 14:39:13.801333 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 14:39:13.801333 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 14:39:13.801333 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 14:39:13.801333 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:39:13.801333 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:39:13.801333 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:39:13.801333 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:39:13.801333 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:39:13.801333 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:39:13.801333 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:39:13.801333 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application with Lock( Jul 26 14:39:13.801333 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:39:13.801333 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:39:13.801333 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:39:13.801333 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:39:13.802582 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:39:13.802582 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:39:13.802582 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:39:13.802582 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:39:13.802582 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 14:39:13.802582 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 14:39:13.802582 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 14:39:13.802582 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 14:39:13.802582 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 14:39:13.802582 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 14:39:13.802582 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 26 14:39:13.802582 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Jul 26 14:39:13.802582 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 419/827] 10.222.0.93 () {56 vars in 1102 bytes} [Tue Jul 26 14:39:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 325 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:39:13.807767 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7893e02-08b4-45ae-8dfe-c741d10b8279 None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:13.813577 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:13.850450 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271834f9-37d8-42ae-a2cc-16fa3f4746aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:13.851448 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271834f9-37d8-42ae-a2cc-16fa3f4746aa None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:13.851981 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271834f9-37d8-42ae-a2cc-16fa3f4746aa None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:13.852715 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271834f9-37d8-42ae-a2cc-16fa3f4746aa None admin] PATH_INFO: `/v3/domains` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:13.854176 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271834f9-37d8-42ae-a2cc-16fa3f4746aa None admin] RBAC: Adding query filter params (name=Default) {{(pid=87055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:39:13.854176 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271834f9-37d8-42ae-a2cc-16fa3f4746aa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:13.854176 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271834f9-37d8-42ae-a2cc-16fa3f4746aa None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:13.872841 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 409/828] 10.222.0.93 () {56 vars in 1109 bytes} [Tue Jul 26 14:39:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:39:13.873553 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271834f9-37d8-42ae-a2cc-16fa3f4746aa None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:13.979255 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7893e02-08b4-45ae-8dfe-c741d10b8279 None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:14.027011 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9185141-5782-42bd-934b-83a1113bb325 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:14.029414 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9185141-5782-42bd-934b-83a1113bb325 None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:14.030002 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9185141-5782-42bd-934b-83a1113bb325 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:14.030501 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9185141-5782-42bd-934b-83a1113bb325 None admin] PATH_INFO: `/v3/services/network` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:14.031957 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9185141-5782-42bd-934b-83a1113bb325 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:14.034496 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9185141-5782-42bd-934b-83a1113bb325 None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:14.038008 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271834f9-37d8-42ae-a2cc-16fa3f4746aa None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:14.048404 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application [None req-e9185141-5782-42bd-934b-83a1113bb325 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 26 14:39:14.048404 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:39:14.048404 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 14:39:14.048404 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 14:39:14.048404 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 14:39:14.048404 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 14:39:14.048404 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 14:39:14.048404 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 14:39:14.048404 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 26 14:39:14.048404 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Jul 26 14:39:14.048404 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 14:39:14.048404 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Jul 26 14:39:14.048404 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:39:14.048404 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:39:14.048404 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:39:14.048404 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:39:14.048404 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:39:14.049481 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:39:14.049481 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:39:14.049481 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:39:14.049481 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:39:14.049481 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:39:14.049481 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:39:14.049481 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 14:39:14.049481 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 14:39:14.049481 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 14:39:14.049481 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 14:39:14.049481 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:39:14.049481 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:39:14.049481 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:39:14.049481 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:39:14.049481 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:39:14.049481 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:39:14.050361 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:39:14.050361 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application with Lock( Jul 26 14:39:14.050361 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:39:14.050361 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:39:14.050361 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:39:14.050361 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:39:14.050361 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:39:14.050361 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:39:14.050361 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:39:14.050361 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:39:14.050361 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 14:39:14.050361 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 14:39:14.050361 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 26 14:39:14.050361 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Jul 26 14:39:14.060918 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 420/829] 10.222.0.93 () {56 vars in 1111 bytes} [Tue Jul 26 14:39:13 2022] GET /identity/v3/services/network => generated 88 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:39:14.060918 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9185141-5782-42bd-934b-83a1113bb325 None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:14.116253 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c53fc7-7588-48a4-827e-23ee0ef851d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:14.117364 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c53fc7-7588-48a4-827e-23ee0ef851d5 None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:14.117881 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c53fc7-7588-48a4-827e-23ee0ef851d5 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:14.118741 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c53fc7-7588-48a4-827e-23ee0ef851d5 None admin] PATH_INFO: `/v3/roles` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:14.121843 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c53fc7-7588-48a4-827e-23ee0ef851d5 None admin] RBAC: Adding query filter params (name=service) {{(pid=87055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:39:14.122727 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c53fc7-7588-48a4-827e-23ee0ef851d5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:14.125544 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c53fc7-7588-48a4-827e-23ee0ef851d5 None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:14.143255 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 410/830] 10.222.0.93 () {56 vars in 1103 bytes} [Tue Jul 26 14:39:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:39:14.144814 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c53fc7-7588-48a4-827e-23ee0ef851d5 None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:14.167096 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:14.220131 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:14.281014 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9185141-5782-42bd-934b-83a1113bb325 None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:14.349671 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd97794-8363-49e6-8ef5-a9e4340d4387 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:14.350828 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd97794-8363-49e6-8ef5-a9e4340d4387 None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:14.351319 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd97794-8363-49e6-8ef5-a9e4340d4387 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:14.351793 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd97794-8363-49e6-8ef5-a9e4340d4387 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:14.365116 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd97794-8363-49e6-8ef5-a9e4340d4387 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:14.403245 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd97794-8363-49e6-8ef5-a9e4340d4387 None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:14.403483 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c53fc7-7588-48a4-827e-23ee0ef851d5 None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:14.403661 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application [None req-1fd97794-8363-49e6-8ef5-a9e4340d4387 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 14:39:14.403661 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:39:14.403661 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:39:14.403661 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:39:14.403661 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:39:14.403661 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:39:14.403661 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:39:14.403661 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:39:14.403661 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:39:14.403661 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:39:14.403661 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:39:14.403661 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:39:14.403661 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 14:39:14.403661 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 14:39:14.403661 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 14:39:14.405390 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 14:39:14.405390 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:39:14.405390 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:39:14.405390 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:39:14.405390 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:39:14.405390 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:39:14.405390 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:39:14.405390 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:39:14.405390 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application with Lock( Jul 26 14:39:14.405390 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:39:14.405390 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:39:14.405390 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:39:14.405390 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:39:14.405390 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:39:14.405390 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:39:14.405390 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:39:14.405390 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:39:14.410406 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 14:39:14.410406 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 14:39:14.410406 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 14:39:14.410406 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 14:39:14.410406 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 14:39:14.410406 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 14:39:14.410406 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 14:39:14.410406 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Jul 26 14:39:14.410406 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 421/831] 10.222.0.93 () {56 vars in 1111 bytes} [Tue Jul 26 14:39:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 337 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:39:14.410406 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd97794-8363-49e6-8ef5-a9e4340d4387 None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:14.445384 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38899dc4-944f-4763-a4a7-d7ffb8f0fb76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:14.449448 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38899dc4-944f-4763-a4a7-d7ffb8f0fb76 None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:14.449448 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38899dc4-944f-4763-a4a7-d7ffb8f0fb76 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:14.449448 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38899dc4-944f-4763-a4a7-d7ffb8f0fb76 None admin] PATH_INFO: `/v3/services` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:14.449448 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38899dc4-944f-4763-a4a7-d7ffb8f0fb76 None admin] RBAC: Adding query filter params (name=network) {{(pid=87055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:39:14.450263 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38899dc4-944f-4763-a4a7-d7ffb8f0fb76 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:14.452051 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38899dc4-944f-4763-a4a7-d7ffb8f0fb76 None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:14.462335 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 411/832] 10.222.0.93 () {56 vars in 1112 bytes} [Tue Jul 26 14:39:14 2022] GET /identity/v3/services?name=network => generated 124 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:39:14.464037 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38899dc4-944f-4763-a4a7-d7ffb8f0fb76 None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:14.566113 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd97794-8363-49e6-8ef5-a9e4340d4387 None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:14.583745 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:14.617130 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378f016f-84ff-47c4-a0e9-a109c92d40ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:14.618148 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378f016f-84ff-47c4-a0e9-a109c92d40ff None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:14.618621 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378f016f-84ff-47c4-a0e9-a109c92d40ff None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:14.619062 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378f016f-84ff-47c4-a0e9-a109c92d40ff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:14.634031 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378f016f-84ff-47c4-a0e9-a109c92d40ff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:14.635946 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378f016f-84ff-47c4-a0e9-a109c92d40ff None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:14.658071 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application [None req-378f016f-84ff-47c4-a0e9-a109c92d40ff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:39:14.658071 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:39:14.658071 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:39:14.658071 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:39:14.658071 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:39:14.658071 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:39:14.658071 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:39:14.658071 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:39:14.658071 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:39:14.658071 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:39:14.658071 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:39:14.658071 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:39:14.658071 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 14:39:14.658071 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 14:39:14.658071 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 14:39:14.659085 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 14:39:14.659085 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:39:14.659085 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:39:14.659085 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:39:14.659085 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:39:14.659085 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:39:14.659085 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:39:14.659085 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:39:14.659085 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application with Lock( Jul 26 14:39:14.659085 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:39:14.659085 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:39:14.659085 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:39:14.659085 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:39:14.659085 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:39:14.659085 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:39:14.659085 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:39:14.659085 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:39:14.659985 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 14:39:14.659985 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 14:39:14.659985 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:39:14.659985 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Jul 26 14:39:14.662776 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 422/833] 10.222.0.93 () {56 vars in 1108 bytes} [Tue Jul 26 14:39:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:39:14.663985 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378f016f-84ff-47c4-a0e9-a109c92d40ff None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:14.674007 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:14.680787 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38899dc4-944f-4763-a4a7-d7ffb8f0fb76 None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:14.753161 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99fcdd3-b667-471a-9445-2a895636d297 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:14.754395 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99fcdd3-b667-471a-9445-2a895636d297 None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:14.755009 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99fcdd3-b667-471a-9445-2a895636d297 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:14.755555 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99fcdd3-b667-471a-9445-2a895636d297 None admin] PATH_INFO: `/v3/projects` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:14.757394 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99fcdd3-b667-471a-9445-2a895636d297 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:39:14.757611 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99fcdd3-b667-471a-9445-2a895636d297 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:14.760640 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99fcdd3-b667-471a-9445-2a895636d297 None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:14.793240 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 412/834] 10.222.0.93 () {56 vars in 1148 bytes} [Tue Jul 26 14:39:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:39:14.793240 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99fcdd3-b667-471a-9445-2a895636d297 None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:14.823289 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378f016f-84ff-47c4-a0e9-a109c92d40ff None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:14.881240 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac44d389-2cbb-45a1-84d2-fcebe989f0a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:14.882342 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac44d389-2cbb-45a1-84d2-fcebe989f0a4 None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:14.882841 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac44d389-2cbb-45a1-84d2-fcebe989f0a4 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:14.883328 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac44d389-2cbb-45a1-84d2-fcebe989f0a4 None admin] PATH_INFO: `/v3/services` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:14.884608 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac44d389-2cbb-45a1-84d2-fcebe989f0a4 None admin] RBAC: Adding query filter params (type=network) {{(pid=87056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:39:14.885150 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac44d389-2cbb-45a1-84d2-fcebe989f0a4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:14.887785 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac44d389-2cbb-45a1-84d2-fcebe989f0a4 None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:14.899239 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 423/835] 10.222.0.93 () {56 vars in 1112 bytes} [Tue Jul 26 14:39:14 2022] GET /identity/v3/services?type=network => generated 350 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:39:14.908150 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac44d389-2cbb-45a1-84d2-fcebe989f0a4 None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:14.959103 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99fcdd3-b667-471a-9445-2a895636d297 None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:14.965095 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:15.018497 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa223e3c-54cb-48df-bc7c-144f094db11c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:15.019589 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa223e3c-54cb-48df-bc7c-144f094db11c None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:15.020086 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa223e3c-54cb-48df-bc7c-144f094db11c None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:15.021708 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa223e3c-54cb-48df-bc7c-144f094db11c None admin] PATH_INFO: `/v3/domains` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:15.023054 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa223e3c-54cb-48df-bc7c-144f094db11c None admin] RBAC: Adding query filter params (name=Default) {{(pid=87055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:39:15.023614 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa223e3c-54cb-48df-bc7c-144f094db11c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:15.026278 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa223e3c-54cb-48df-bc7c-144f094db11c None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:15.054775 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 413/836] 10.222.0.93 () {56 vars in 1109 bytes} [Tue Jul 26 14:39:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:39:15.054775 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dff1d1-c500-4efd-9474-1d295912274d None None] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:15.054775 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dff1d1-c500-4efd-9474-1d295912274d None None] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:15.054775 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dff1d1-c500-4efd-9474-1d295912274d None None] PATH_INFO: `/` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:15.056722 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 414/837] 10.222.0.93 () {54 vars in 926 bytes} [Tue Jul 26 14:39:15 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:39:15.058126 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dff1d1-c500-4efd-9474-1d295912274d None None] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:15.094884 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac44d389-2cbb-45a1-84d2-fcebe989f0a4 None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:15.105479 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:15.139472 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ef21c1-9937-40da-869b-c6a1e692d967 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:15.140109 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ef21c1-9937-40da-869b-c6a1e692d967 None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:15.140388 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ef21c1-9937-40da-869b-c6a1e692d967 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:15.140656 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ef21c1-9937-40da-869b-c6a1e692d967 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:15.141463 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ef21c1-9937-40da-869b-c6a1e692d967 None admin] RBAC: Adding query filter params (role.id=94e105ff8ee4486abd501415cc05ba38, scope.project.id=c422a2290a14424da20e2841cbc1741d, user.id=2e86fe36c9bf49a481c9f15ac7571b88) {{(pid=87056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:39:15.141773 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ef21c1-9937-40da-869b-c6a1e692d967 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:15.143497 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ef21c1-9937-40da-869b-c6a1e692d967 None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:15.157498 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 424/838] 10.222.0.93 () {56 vars in 1374 bytes} [Tue Jul 26 14:39:14 2022] GET /identity/v3/role_assignments?user.id=2e86fe36c9bf49a481c9f15ac7571b88&scope.project.id=c422a2290a14424da20e2841cbc1741d&role.id=94e105ff8ee4486abd501415cc05ba38 => generated 608 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:39:15.159655 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ef21c1-9937-40da-869b-c6a1e692d967 None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:15.289189 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dff1d1-c500-4efd-9474-1d295912274d None None] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:15.355800 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d70862a-beaf-4072-8e96-e774b1c70dba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:15.357124 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d70862a-beaf-4072-8e96-e774b1c70dba None admin] REQUEST_METHOD: `POST` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:15.357800 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d70862a-beaf-4072-8e96-e774b1c70dba None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:15.358489 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d70862a-beaf-4072-8e96-e774b1c70dba None admin] PATH_INFO: `/v3/endpoints` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:15.360012 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d70862a-beaf-4072-8e96-e774b1c70dba None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:15.362879 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d70862a-beaf-4072-8e96-e774b1c70dba None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:15.372303 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:15.387224 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ef21c1-9937-40da-869b-c6a1e692d967 None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:15.444450 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5e5434-2372-4421-8fb0-4798f788a406 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:15.445233 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5e5434-2372-4421-8fb0-4798f788a406 None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:15.445546 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5e5434-2372-4421-8fb0-4798f788a406 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:15.445862 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5e5434-2372-4421-8fb0-4798f788a406 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:15.457784 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5e5434-2372-4421-8fb0-4798f788a406 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:15.460452 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5e5434-2372-4421-8fb0-4798f788a406 None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:15.479213 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application [None req-0c5e5434-2372-4421-8fb0-4798f788a406 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 26 14:39:15.479213 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:39:15.479213 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:39:15.479213 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:39:15.479213 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:39:15.479213 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:39:15.479213 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:39:15.479213 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:39:15.479213 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:39:15.479213 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:39:15.479213 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:39:15.479213 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:39:15.479213 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 14:39:15.479213 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 14:39:15.479213 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 14:39:15.479213 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 14:39:15.481476 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:39:15.481476 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:39:15.481476 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 14:39:15.481476 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 14:39:15.481476 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 14:39:15.481476 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 14:39:15.481476 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:39:15.481476 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:39:15.481476 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:39:15.481476 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:39:15.481476 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:39:15.481476 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application with Lock( Jul 26 14:39:15.481476 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:39:15.481476 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:39:15.481476 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:39:15.481476 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:39:15.481476 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:39:15.481476 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:39:15.483828 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:39:15.483828 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:39:15.483828 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 14:39:15.483828 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 14:39:15.483828 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 14:39:15.483828 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 14:39:15.483828 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 14:39:15.483828 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 14:39:15.483828 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 26 14:39:15.483828 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Jul 26 14:39:15.483828 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 425/839] 10.222.0.93 () {56 vars in 1117 bytes} [Tue Jul 26 14:39:15 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 322 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:39:15.483828 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ceb03d2-333d-4ea2-8f90-ea61bc763993 None None] REQUEST_METHOD: `POST` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:15.483828 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ceb03d2-333d-4ea2-8f90-ea61bc763993 None None] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:15.485515 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ceb03d2-333d-4ea2-8f90-ea61bc763993 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:15.503597 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.auth.core [None req-5ceb03d2-333d-4ea2-8f90-ea61bc763993 None None] MFA Rules not processed for user `e5ef88cc058f425b882bcb87a1e1e75c`. Rule list: `[]` (Enabled: `True`). {{(pid=87056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:39:15.505393 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.fernet_utils [None req-5ceb03d2-333d-4ea2-8f90-ea61bc763993 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:39:15.573462 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 415/840] 10.222.0.93 () {60 vars in 1144 bytes} [Tue Jul 26 14:39:15 2022] POST /identity/v3/endpoints => generated 327 bytes in 516 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 14:39:15.574702 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d70862a-beaf-4072-8e96-e774b1c70dba None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:15.666356 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 426/841] 10.222.0.93 () {58 vars in 1023 bytes} [Tue Jul 26 14:39:15 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 14:39:15.686345 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ceb03d2-333d-4ea2-8f90-ea61bc763993 None None] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:15.742490 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:15.798005 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:15.823737 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ceb03d2-333d-4ea2-8f90-ea61bc763993 None None] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:15.828742 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d70862a-beaf-4072-8e96-e774b1c70dba None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:15.872782 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6360812-9862-493f-8f73-97cb11de6b62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:15.873777 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6360812-9862-493f-8f73-97cb11de6b62 None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:15.874481 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6360812-9862-493f-8f73-97cb11de6b62 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:15.875097 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6360812-9862-493f-8f73-97cb11de6b62 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:15.875905 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6360812-9862-493f-8f73-97cb11de6b62 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:15.877542 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6360812-9862-493f-8f73-97cb11de6b62 None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:15.901852 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application [None req-f6360812-9862-493f-8f73-97cb11de6b62 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 26 14:39:15.901852 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:39:15.901852 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 14:39:15.901852 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 14:39:15.901852 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 14:39:15.901852 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 14:39:15.901852 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 14:39:15.901852 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 14:39:15.901852 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 26 14:39:15.901852 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Jul 26 14:39:15.901852 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 14:39:15.901852 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Jul 26 14:39:15.901852 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:39:15.901852 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:39:15.901852 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:39:15.901852 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:39:15.901852 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:39:15.903143 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:39:15.903143 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:39:15.903143 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:39:15.903143 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:39:15.903143 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:39:15.903143 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:39:15.903143 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 14:39:15.903143 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 14:39:15.903143 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 14:39:15.903143 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 14:39:15.903143 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:39:15.903143 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:39:15.903143 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:39:15.903143 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:39:15.903143 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:39:15.903143 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:39:15.904014 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:39:15.904014 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application with Lock( Jul 26 14:39:15.904014 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:39:15.904014 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:39:15.904014 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:39:15.904014 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:39:15.904014 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:39:15.904014 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:39:15.904014 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:39:15.904014 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:39:15.904014 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 14:39:15.904014 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 14:39:15.904014 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 26 14:39:15.904014 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Jul 26 14:39:15.913346 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 427/842] 10.222.0.93 () {56 vars in 1114 bytes} [Tue Jul 26 14:39:15 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 14:39:15.923423 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6360812-9862-493f-8f73-97cb11de6b62 None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:15.956799 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b33e7bb-c213-4607-aae1-989a7771025a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:15.957991 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b33e7bb-c213-4607-aae1-989a7771025a None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:15.958464 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b33e7bb-c213-4607-aae1-989a7771025a None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:15.958962 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b33e7bb-c213-4607-aae1-989a7771025a None admin] PATH_INFO: `/v3/users` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:15.960726 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b33e7bb-c213-4607-aae1-989a7771025a None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=87055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:39:15.961433 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b33e7bb-c213-4607-aae1-989a7771025a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:15.964423 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b33e7bb-c213-4607-aae1-989a7771025a None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:16.014543 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 416/843] 10.222.0.93 () {56 vars in 1149 bytes} [Tue Jul 26 14:39:15 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 440 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:39:16.024851 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b33e7bb-c213-4607-aae1-989a7771025a None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:16.090759 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6360812-9862-493f-8f73-97cb11de6b62 None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:16.133552 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7df5c8-1320-40e7-a892-0eedffbcd1a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:16.134470 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7df5c8-1320-40e7-a892-0eedffbcd1a1 None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:16.134901 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7df5c8-1320-40e7-a892-0eedffbcd1a1 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:16.135323 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7df5c8-1320-40e7-a892-0eedffbcd1a1 None admin] PATH_INFO: `/v3/services` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:16.136201 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7df5c8-1320-40e7-a892-0eedffbcd1a1 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=87056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:39:16.136681 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7df5c8-1320-40e7-a892-0eedffbcd1a1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:16.138428 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7df5c8-1320-40e7-a892-0eedffbcd1a1 None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:16.144500 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 428/844] 10.222.0.93 () {56 vars in 1114 bytes} [Tue Jul 26 14:39:15 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:39:16.151280 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7df5c8-1320-40e7-a892-0eedffbcd1a1 None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:16.167682 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:16.235569 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b33e7bb-c213-4607-aae1-989a7771025a None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:16.281817 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4ece75-e7ae-455a-984b-252994528816 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:16.282679 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4ece75-e7ae-455a-984b-252994528816 None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:16.283035 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4ece75-e7ae-455a-984b-252994528816 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:16.283406 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4ece75-e7ae-455a-984b-252994528816 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:16.287350 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:16.307351 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7df5c8-1320-40e7-a892-0eedffbcd1a1 None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:16.358934 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c665519a-ca3f-43ce-9864-7c629d4b6f43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:16.360164 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c665519a-ca3f-43ce-9864-7c629d4b6f43 None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:16.360609 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c665519a-ca3f-43ce-9864-7c629d4b6f43 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:16.361094 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c665519a-ca3f-43ce-9864-7c629d4b6f43 None admin] PATH_INFO: `/v3/services` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:16.362455 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c665519a-ca3f-43ce-9864-7c629d4b6f43 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=87056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:39:16.362922 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c665519a-ca3f-43ce-9864-7c629d4b6f43 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:16.365091 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c665519a-ca3f-43ce-9864-7c629d4b6f43 None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:16.378603 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 429/845] 10.222.0.93 () {56 vars in 1114 bytes} [Tue Jul 26 14:39:16 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:39:16.406962 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4ece75-e7ae-455a-984b-252994528816 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:16.410145 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4ece75-e7ae-455a-984b-252994528816 None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:16.578839 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 417/846] 10.222.0.93 () {58 vars in 1282 bytes} [Tue Jul 26 14:39:16 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 554 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 26 14:39:16.583388 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c665519a-ca3f-43ce-9864-7c629d4b6f43 None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:16.690187 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:16.739981 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c665519a-ca3f-43ce-9864-7c629d4b6f43 None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:16.753766 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67c19bc-1632-4501-93b4-cd077d8e2ddc None None] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:16.755278 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67c19bc-1632-4501-93b4-cd077d8e2ddc None None] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:16.756055 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67c19bc-1632-4501-93b4-cd077d8e2ddc None None] PATH_INFO: `/` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:16.765425 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 418/847] 10.222.0.93 () {54 vars in 926 bytes} [Tue Jul 26 14:39:16 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:39:16.768189 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dfc934-2844-4e22-9f6b-0515cf8c15c6 None None] REQUEST_METHOD: `POST` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:16.769105 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dfc934-2844-4e22-9f6b-0515cf8c15c6 None None] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:16.769855 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dfc934-2844-4e22-9f6b-0515cf8c15c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:16.793125 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24306314-735a-4e7c-8c89-99939add9c18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:16.794600 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24306314-735a-4e7c-8c89-99939add9c18 None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:16.795115 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24306314-735a-4e7c-8c89-99939add9c18 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:16.795615 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24306314-735a-4e7c-8c89-99939add9c18 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:16.810756 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.auth.core [None req-a1dfc934-2844-4e22-9f6b-0515cf8c15c6 None None] MFA Rules not processed for user `e5ef88cc058f425b882bcb87a1e1e75c`. Rule list: `[]` (Enabled: `True`). {{(pid=87055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:39:16.814679 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.fernet_utils [None req-a1dfc934-2844-4e22-9f6b-0515cf8c15c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:39:16.818541 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24306314-735a-4e7c-8c89-99939add9c18 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:16.822888 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24306314-735a-4e7c-8c89-99939add9c18 None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:16.855018 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application [None req-24306314-735a-4e7c-8c89-99939add9c18 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:39:16.855018 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:39:16.855018 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:39:16.855018 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:39:16.855018 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:39:16.855018 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:39:16.855018 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:39:16.855018 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:39:16.855018 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:39:16.855018 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:39:16.855018 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:39:16.855018 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:39:16.855018 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 14:39:16.855018 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 14:39:16.855018 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 14:39:16.857637 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 14:39:16.857637 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:39:16.857637 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:39:16.857637 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:39:16.857637 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:39:16.857637 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:39:16.857637 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:39:16.857637 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:39:16.857637 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application with Lock( Jul 26 14:39:16.857637 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:39:16.857637 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:39:16.857637 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:39:16.857637 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:39:16.857637 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:39:16.857637 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:39:16.857637 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:39:16.857637 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:39:16.859708 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 14:39:16.859708 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 14:39:16.859708 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:39:16.859708 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Jul 26 14:39:16.866606 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 430/848] 10.222.0.93 () {56 vars in 1108 bytes} [Tue Jul 26 14:39:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 14:39:16.869478 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24306314-735a-4e7c-8c89-99939add9c18 None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:16.875054 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:16.929688 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 419/849] 10.222.0.93 () {58 vars in 1023 bytes} [Tue Jul 26 14:39:16 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 26 14:39:16.971000 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dfc934-2844-4e22-9f6b-0515cf8c15c6 None None] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:17.090125 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24306314-735a-4e7c-8c89-99939add9c18 None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:17.117281 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:17.129412 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3269ef1c-3fc9-4475-a230-93ff18ec3680 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:17.132739 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3269ef1c-3fc9-4475-a230-93ff18ec3680 None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:17.132739 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3269ef1c-3fc9-4475-a230-93ff18ec3680 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:17.132739 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3269ef1c-3fc9-4475-a230-93ff18ec3680 None admin] PATH_INFO: `/v3/domains` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:17.132739 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3269ef1c-3fc9-4475-a230-93ff18ec3680 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:39:17.132739 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3269ef1c-3fc9-4475-a230-93ff18ec3680 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:17.133448 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3269ef1c-3fc9-4475-a230-93ff18ec3680 None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:17.142383 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dfc934-2844-4e22-9f6b-0515cf8c15c6 None None] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:17.150309 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 431/850] 10.222.0.93 () {56 vars in 1109 bytes} [Tue Jul 26 14:39:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:39:17.157314 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3269ef1c-3fc9-4475-a230-93ff18ec3680 None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:17.218379 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efa2ad8-9c87-4c17-8960-15cbc283fde9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:17.220009 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efa2ad8-9c87-4c17-8960-15cbc283fde9 None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:17.220974 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efa2ad8-9c87-4c17-8960-15cbc283fde9 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:17.221893 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efa2ad8-9c87-4c17-8960-15cbc283fde9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:17.239635 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efa2ad8-9c87-4c17-8960-15cbc283fde9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 14:39:17.246179 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application [None req-7efa2ad8-9c87-4c17-8960-15cbc283fde9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 14:39:17.246179 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:39:17.246179 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:39:17.246179 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:39:17.246179 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:39:17.246179 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:39:17.246179 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:39:17.246179 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:39:17.246179 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:39:17.246179 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:39:17.246179 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:39:17.246179 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:39:17.246179 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 14:39:17.246179 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 14:39:17.246179 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 14:39:17.246179 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 14:39:17.247200 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 14:39:17.247200 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 14:39:17.247200 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 14:39:17.247200 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 14:39:17.247200 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:39:17.247200 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:39:17.247200 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:39:17.247200 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:39:17.247200 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:39:17.247200 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:39:17.247200 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:39:17.247200 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application with Lock( Jul 26 14:39:17.247200 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:39:17.247200 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:39:17.247200 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:39:17.247200 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:39:17.248050 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:39:17.248050 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:39:17.248050 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:39:17.248050 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:39:17.248050 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 14:39:17.248050 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 14:39:17.248050 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 14:39:17.248050 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 14:39:17.248050 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 14:39:17.248050 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 14:39:17.248050 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 14:39:17.248050 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Jul 26 14:39:17.257086 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 420/851] 10.222.0.93 () {56 vars in 1096 bytes} [Tue Jul 26 14:39:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 14:39:17.258600 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efa2ad8-9c87-4c17-8960-15cbc283fde9 None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:17.288462 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3269ef1c-3fc9-4475-a230-93ff18ec3680 None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:17.294937 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:17.330193 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e81f1ee-f8ad-4901-a060-33405523beea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:17.339504 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e81f1ee-f8ad-4901-a060-33405523beea None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:17.339504 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e81f1ee-f8ad-4901-a060-33405523beea None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:17.339504 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e81f1ee-f8ad-4901-a060-33405523beea None admin] PATH_INFO: `/v3/projects/service` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:17.341677 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e81f1ee-f8ad-4901-a060-33405523beea None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:17.343911 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e81f1ee-f8ad-4901-a060-33405523beea None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:17.360335 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application [None req-2e81f1ee-f8ad-4901-a060-33405523beea None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 14:39:17.360335 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:39:17.360335 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:39:17.360335 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:39:17.360335 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:39:17.360335 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:39:17.360335 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:39:17.360335 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:39:17.360335 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:39:17.360335 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:39:17.360335 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:39:17.360335 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:39:17.360335 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 14:39:17.360335 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 14:39:17.360335 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 14:39:17.361300 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 14:39:17.361300 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:39:17.361300 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:39:17.361300 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:39:17.361300 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:39:17.361300 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:39:17.361300 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:39:17.361300 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:39:17.361300 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application with Lock( Jul 26 14:39:17.361300 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:39:17.361300 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:39:17.361300 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:39:17.361300 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:39:17.361300 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:39:17.361300 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:39:17.361300 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:39:17.361300 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:39:17.362206 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 14:39:17.362206 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 14:39:17.362206 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 14:39:17.362206 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 14:39:17.362206 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 14:39:17.362206 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 14:39:17.362206 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 14:39:17.362206 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Jul 26 14:39:17.362206 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 432/852] 10.222.0.93 () {56 vars in 1111 bytes} [Tue Jul 26 14:39:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 14:39:17.370233 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e81f1ee-f8ad-4901-a060-33405523beea None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:17.394401 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efa2ad8-9c87-4c17-8960-15cbc283fde9 None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:17.426834 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:17.448473 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de568e43-626b-4cd0-b729-3045702f89c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:17.449461 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de568e43-626b-4cd0-b729-3045702f89c4 None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:17.449893 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de568e43-626b-4cd0-b729-3045702f89c4 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:17.450348 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de568e43-626b-4cd0-b729-3045702f89c4 None admin] PATH_INFO: `/v3/roles` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:17.451586 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de568e43-626b-4cd0-b729-3045702f89c4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:39:17.452085 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de568e43-626b-4cd0-b729-3045702f89c4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:17.454670 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de568e43-626b-4cd0-b729-3045702f89c4 None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:17.467574 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 421/853] 10.222.0.93 () {56 vars in 1099 bytes} [Tue Jul 26 14:39:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:39:17.475015 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de568e43-626b-4cd0-b729-3045702f89c4 None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:17.502200 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e81f1ee-f8ad-4901-a060-33405523beea None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:17.550658 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c94417-0d74-4562-b249-1911d1509311 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:17.551446 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c94417-0d74-4562-b249-1911d1509311 None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:17.552271 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c94417-0d74-4562-b249-1911d1509311 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:17.552558 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c94417-0d74-4562-b249-1911d1509311 None admin] PATH_INFO: `/v3/projects` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:17.553969 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c94417-0d74-4562-b249-1911d1509311 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:39:17.554307 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c94417-0d74-4562-b249-1911d1509311 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:17.556137 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c94417-0d74-4562-b249-1911d1509311 None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:17.580280 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 433/854] 10.222.0.93 () {56 vars in 1148 bytes} [Tue Jul 26 14:39:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:39:17.583018 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c94417-0d74-4562-b249-1911d1509311 None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:17.587157 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:17.607302 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de568e43-626b-4cd0-b729-3045702f89c4 None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:17.672798 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8bd397-903e-4a79-8bee-dd755b1c0c2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:17.674842 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8bd397-903e-4a79-8bee-dd755b1c0c2d None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:17.675531 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8bd397-903e-4a79-8bee-dd755b1c0c2d None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:17.678469 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8bd397-903e-4a79-8bee-dd755b1c0c2d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:17.700515 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8bd397-903e-4a79-8bee-dd755b1c0c2d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:17.702617 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8bd397-903e-4a79-8bee-dd755b1c0c2d None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:17.738149 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application [None req-da8bd397-903e-4a79-8bee-dd755b1c0c2d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:39:17.738149 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:39:17.738149 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:39:17.738149 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:39:17.738149 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:39:17.738149 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:39:17.738149 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:39:17.738149 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:39:17.738149 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:39:17.738149 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:39:17.738149 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:39:17.738149 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:39:17.738149 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 14:39:17.738149 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 14:39:17.738149 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 14:39:17.739825 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 14:39:17.739825 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:39:17.739825 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:39:17.739825 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:39:17.739825 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:39:17.739825 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:39:17.739825 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:39:17.739825 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:39:17.739825 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application with Lock( Jul 26 14:39:17.739825 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:39:17.739825 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:39:17.739825 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:39:17.739825 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:39:17.739825 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:39:17.739825 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:39:17.739825 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:39:17.739825 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:39:17.740712 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 14:39:17.740712 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 14:39:17.740712 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:39:17.740712 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Jul 26 14:39:17.750769 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 422/855] 10.222.0.93 () {56 vars in 1108 bytes} [Tue Jul 26 14:39:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:39:17.754367 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8bd397-903e-4a79-8bee-dd755b1c0c2d None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:17.802574 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c94417-0d74-4562-b249-1911d1509311 None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:17.818891 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:17.876759 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b225615a-1900-41fb-ace5-32fefa9cdc99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:17.878198 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b225615a-1900-41fb-ace5-32fefa9cdc99 None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:17.880686 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b225615a-1900-41fb-ace5-32fefa9cdc99 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:17.881256 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b225615a-1900-41fb-ace5-32fefa9cdc99 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:17.882418 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b225615a-1900-41fb-ace5-32fefa9cdc99 None admin] RBAC: Adding query filter params (role.id=2e45ca312cda4bef9263725ae1c6dab7, scope.project.id=c422a2290a14424da20e2841cbc1741d, user.id=0205dfcfb5e5404c95aefc1f45a1e1e6) {{(pid=87056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:39:17.882948 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b225615a-1900-41fb-ace5-32fefa9cdc99 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:17.885546 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b225615a-1900-41fb-ace5-32fefa9cdc99 None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:17.908418 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 434/856] 10.222.0.93 () {56 vars in 1374 bytes} [Tue Jul 26 14:39:17 2022] GET /identity/v3/role_assignments?user.id=0205dfcfb5e5404c95aefc1f45a1e1e6&scope.project.id=c422a2290a14424da20e2841cbc1741d&role.id=2e45ca312cda4bef9263725ae1c6dab7 => generated 608 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:39:17.984376 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8bd397-903e-4a79-8bee-dd755b1c0c2d None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:18.027960 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7b0317-919c-45f8-a83b-669748e051d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:18.029057 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7b0317-919c-45f8-a83b-669748e051d4 None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:18.029595 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7b0317-919c-45f8-a83b-669748e051d4 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:18.030089 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7b0317-919c-45f8-a83b-669748e051d4 None admin] PATH_INFO: `/v3/domains` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:18.031114 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7b0317-919c-45f8-a83b-669748e051d4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:39:18.031934 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7b0317-919c-45f8-a83b-669748e051d4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:18.033716 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7b0317-919c-45f8-a83b-669748e051d4 None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:18.045210 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:18.052967 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 423/857] 10.222.0.93 () {56 vars in 1109 bytes} [Tue Jul 26 14:39:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:39:18.060022 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b225615a-1900-41fb-ace5-32fefa9cdc99 None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:18.204467 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b225615a-1900-41fb-ace5-32fefa9cdc99 None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:18.266230 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799435d0-e224-40f0-a038-156457147d8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:18.266859 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799435d0-e224-40f0-a038-156457147d8d None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:18.267145 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799435d0-e224-40f0-a038-156457147d8d None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:18.267448 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799435d0-e224-40f0-a038-156457147d8d None admin] PATH_INFO: `/v3/users/swift` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:18.282636 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799435d0-e224-40f0-a038-156457147d8d None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:18.286364 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799435d0-e224-40f0-a038-156457147d8d None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:18.300066 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application [None req-799435d0-e224-40f0-a038-156457147d8d None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 26 14:39:18.300066 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:39:18.300066 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:39:18.300066 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:39:18.300066 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:39:18.300066 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:39:18.300066 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:39:18.300066 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:39:18.300066 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:39:18.300066 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:39:18.300066 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:39:18.300066 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:39:18.300066 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 14:39:18.300066 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 14:39:18.300066 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 14:39:18.300066 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 14:39:18.301113 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:39:18.301113 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:39:18.301113 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 14:39:18.301113 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 14:39:18.301113 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 14:39:18.301113 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 14:39:18.301113 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:39:18.301113 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:39:18.301113 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:39:18.301113 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:39:18.301113 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:39:18.301113 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application with Lock( Jul 26 14:39:18.301113 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:39:18.301113 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:39:18.301113 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:39:18.301113 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:39:18.301113 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:39:18.301113 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:39:18.303396 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:39:18.303396 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:39:18.303396 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 14:39:18.303396 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 14:39:18.303396 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 14:39:18.303396 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 14:39:18.303396 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 14:39:18.303396 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 14:39:18.303396 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 26 14:39:18.303396 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Jul 26 14:39:18.307120 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 435/858] 10.222.0.93 () {56 vars in 1096 bytes} [Tue Jul 26 14:39:18 2022] GET /identity/v3/users/swift => generated 83 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:39:18.313432 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7b0317-919c-45f8-a83b-669748e051d4 None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:18.445427 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7b0317-919c-45f8-a83b-669748e051d4 None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:18.486221 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961ecb6b-049d-4501-a9d3-c0bd72fd278a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:18.487336 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961ecb6b-049d-4501-a9d3-c0bd72fd278a None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:18.487886 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961ecb6b-049d-4501-a9d3-c0bd72fd278a None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:18.488413 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961ecb6b-049d-4501-a9d3-c0bd72fd278a None admin] PATH_INFO: `/v3/users` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:18.490098 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961ecb6b-049d-4501-a9d3-c0bd72fd278a None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=87055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:39:18.490676 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961ecb6b-049d-4501-a9d3-c0bd72fd278a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:18.492402 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961ecb6b-049d-4501-a9d3-c0bd72fd278a None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:18.513855 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 424/859] 10.222.0.93 () {56 vars in 1135 bytes} [Tue Jul 26 14:39:18 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:39:18.519605 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799435d0-e224-40f0-a038-156457147d8d None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:18.555617 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:18.646415 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799435d0-e224-40f0-a038-156457147d8d None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:18.688117 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c1cc0e-e09b-45aa-ab12-cb4c6871b47d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:18.688774 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c1cc0e-e09b-45aa-ab12-cb4c6871b47d None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:18.689056 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c1cc0e-e09b-45aa-ab12-cb4c6871b47d None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:18.689339 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c1cc0e-e09b-45aa-ab12-cb4c6871b47d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:18.775334 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c1cc0e-e09b-45aa-ab12-cb4c6871b47d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:18.776752 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c1cc0e-e09b-45aa-ab12-cb4c6871b47d None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:18.810882 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:18.928716 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 436/860] 10.222.0.93 () {58 vars in 1282 bytes} [Tue Jul 26 14:39:18 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 26 14:39:18.936393 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961ecb6b-049d-4501-a9d3-c0bd72fd278a None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:18.955411 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c988436-9133-4f7f-a14a-bf0fabc801cc None None] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:18.956110 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c988436-9133-4f7f-a14a-bf0fabc801cc None None] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:18.956409 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c988436-9133-4f7f-a14a-bf0fabc801cc None None] PATH_INFO: `/` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:18.959550 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 437/861] 10.222.0.93 () {54 vars in 926 bytes} [Tue Jul 26 14:39:18 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:39:18.967591 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18f4436-38e3-46fb-af8b-f9e557ac65e0 None None] REQUEST_METHOD: `POST` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:18.968187 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18f4436-38e3-46fb-af8b-f9e557ac65e0 None None] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:18.968910 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18f4436-38e3-46fb-af8b-f9e557ac65e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:19.003165 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.auth.core [None req-b18f4436-38e3-46fb-af8b-f9e557ac65e0 None None] MFA Rules not processed for user `e5ef88cc058f425b882bcb87a1e1e75c`. Rule list: `[]` (Enabled: `True`). {{(pid=87056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:39:19.005774 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.fernet_utils [None req-b18f4436-38e3-46fb-af8b-f9e557ac65e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:39:19.020900 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:19.085632 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961ecb6b-049d-4501-a9d3-c0bd72fd278a None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:19.133001 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615c0912-9398-4fc0-b3e9-8b9e105f23c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:19.133702 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615c0912-9398-4fc0-b3e9-8b9e105f23c0 None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:19.133990 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615c0912-9398-4fc0-b3e9-8b9e105f23c0 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:19.134418 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615c0912-9398-4fc0-b3e9-8b9e105f23c0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:19.147773 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615c0912-9398-4fc0-b3e9-8b9e105f23c0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:19.149425 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615c0912-9398-4fc0-b3e9-8b9e105f23c0 None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:19.149595 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 438/862] 10.222.0.93 () {58 vars in 1023 bytes} [Tue Jul 26 14:39:18 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 14:39:19.171707 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application [None req-615c0912-9398-4fc0-b3e9-8b9e105f23c0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:39:19.171707 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:39:19.171707 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:39:19.171707 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:39:19.171707 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:39:19.171707 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:39:19.171707 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:39:19.171707 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:39:19.171707 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:39:19.171707 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:39:19.171707 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:39:19.171707 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:39:19.171707 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 14:39:19.171707 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 14:39:19.171707 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 14:39:19.173463 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 14:39:19.173463 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:39:19.173463 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:39:19.173463 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:39:19.173463 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:39:19.173463 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:39:19.173463 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:39:19.173463 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:39:19.173463 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application with Lock( Jul 26 14:39:19.173463 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:39:19.173463 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:39:19.173463 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:39:19.173463 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:39:19.173463 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:39:19.173463 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:39:19.173463 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:39:19.173463 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:39:19.175306 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 14:39:19.175306 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 14:39:19.175306 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:39:19.175306 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Jul 26 14:39:19.175306 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 425/863] 10.222.0.93 () {56 vars in 1108 bytes} [Tue Jul 26 14:39:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:39:19.185620 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18f4436-38e3-46fb-af8b-f9e557ac65e0 None None] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:19.187124 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615c0912-9398-4fc0-b3e9-8b9e105f23c0 None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:19.311697 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:19.334839 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615c0912-9398-4fc0-b3e9-8b9e105f23c0 None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:19.347519 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:19.382454 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20602f02-ebfe-4ae7-bab2-fb423909746b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:19.383411 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20602f02-ebfe-4ae7-bab2-fb423909746b None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:19.383847 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20602f02-ebfe-4ae7-bab2-fb423909746b None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:19.384314 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20602f02-ebfe-4ae7-bab2-fb423909746b None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:19.385299 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20602f02-ebfe-4ae7-bab2-fb423909746b None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:19.387426 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20602f02-ebfe-4ae7-bab2-fb423909746b None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:19.392010 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18f4436-38e3-46fb-af8b-f9e557ac65e0 None None] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:19.399311 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application [None req-20602f02-ebfe-4ae7-bab2-fb423909746b None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 26 14:39:19.399311 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:39:19.399311 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 14:39:19.399311 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 14:39:19.399311 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 14:39:19.399311 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 14:39:19.399311 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 14:39:19.399311 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 14:39:19.399311 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 26 14:39:19.399311 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Jul 26 14:39:19.399311 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 14:39:19.399311 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Jul 26 14:39:19.399311 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:39:19.399311 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:39:19.399311 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:39:19.399311 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:39:19.400464 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:39:19.400464 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:39:19.400464 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:39:19.400464 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:39:19.400464 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:39:19.400464 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:39:19.400464 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:39:19.400464 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 14:39:19.400464 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 14:39:19.400464 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 14:39:19.400464 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 14:39:19.400464 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:39:19.400464 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:39:19.400464 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:39:19.400464 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:39:19.400464 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:39:19.401367 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:39:19.401367 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:39:19.401367 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application with Lock( Jul 26 14:39:19.401367 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:39:19.401367 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:39:19.401367 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:39:19.401367 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:39:19.401367 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:39:19.401367 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:39:19.401367 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:39:19.401367 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:39:19.401367 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 14:39:19.401367 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 14:39:19.401367 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 26 14:39:19.401367 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Jul 26 14:39:19.403965 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 426/864] 10.222.0.93 () {56 vars in 1132 bytes} [Tue Jul 26 14:39:19 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:39:19.413517 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20602f02-ebfe-4ae7-bab2-fb423909746b None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:19.464235 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e424d9-454d-4dc5-ab94-60e7a6554262 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:19.465391 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e424d9-454d-4dc5-ab94-60e7a6554262 None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:19.465808 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e424d9-454d-4dc5-ab94-60e7a6554262 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:19.466199 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e424d9-454d-4dc5-ab94-60e7a6554262 None admin] PATH_INFO: `/v3/domains` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:19.467400 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e424d9-454d-4dc5-ab94-60e7a6554262 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:39:19.467894 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e424d9-454d-4dc5-ab94-60e7a6554262 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:19.470104 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e424d9-454d-4dc5-ab94-60e7a6554262 None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:19.497196 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 439/865] 10.222.0.93 () {56 vars in 1109 bytes} [Tue Jul 26 14:39:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:39:19.497196 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a80b3a7-b5ec-4890-8775-25a2c3934e28 None None] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:19.497196 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a80b3a7-b5ec-4890-8775-25a2c3934e28 None None] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:19.497196 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a80b3a7-b5ec-4890-8775-25a2c3934e28 None None] PATH_INFO: `/` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:19.499639 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 440/866] 10.222.0.93 () {54 vars in 926 bytes} [Tue Jul 26 14:39:19 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:39:19.501181 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a80b3a7-b5ec-4890-8775-25a2c3934e28 None None] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:19.543050 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20602f02-ebfe-4ae7-bab2-fb423909746b None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:19.586789 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d84a05b-9fee-45bc-8b9f-b1387150823a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:19.587429 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d84a05b-9fee-45bc-8b9f-b1387150823a None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:19.587701 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d84a05b-9fee-45bc-8b9f-b1387150823a None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:19.587996 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d84a05b-9fee-45bc-8b9f-b1387150823a None admin] PATH_INFO: `/v3/services` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:19.588664 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d84a05b-9fee-45bc-8b9f-b1387150823a None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=87055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:39:19.588971 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d84a05b-9fee-45bc-8b9f-b1387150823a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:19.591295 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d84a05b-9fee-45bc-8b9f-b1387150823a None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:19.602127 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 427/867] 10.222.0.93 () {56 vars in 1126 bytes} [Tue Jul 26 14:39:19 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:39:19.603709 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fb213e-5712-4f0c-aeef-9bf3b3f9c45a None None] REQUEST_METHOD: `POST` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:19.604122 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fb213e-5712-4f0c-aeef-9bf3b3f9c45a None None] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:19.604410 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fb213e-5712-4f0c-aeef-9bf3b3f9c45a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:19.632433 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.auth.core [None req-55fb213e-5712-4f0c-aeef-9bf3b3f9c45a None None] MFA Rules not processed for user `e5ef88cc058f425b882bcb87a1e1e75c`. Rule list: `[]` (Enabled: `True`). {{(pid=87055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:39:19.633753 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.fernet_utils [None req-55fb213e-5712-4f0c-aeef-9bf3b3f9c45a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:39:19.663836 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a80b3a7-b5ec-4890-8775-25a2c3934e28 None None] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:19.694856 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:19.698007 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:19.720803 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e5921a-1c23-4110-ae7f-74046a560d2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:19.721822 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e5921a-1c23-4110-ae7f-74046a560d2c None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:19.722338 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e5921a-1c23-4110-ae7f-74046a560d2c None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:19.722766 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e5921a-1c23-4110-ae7f-74046a560d2c None admin] PATH_INFO: `/v3/projects/service` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:19.733770 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e5921a-1c23-4110-ae7f-74046a560d2c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:19.735976 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e5921a-1c23-4110-ae7f-74046a560d2c None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:19.754090 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application [None req-25e5921a-1c23-4110-ae7f-74046a560d2c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 14:39:19.754090 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:39:19.754090 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:39:19.754090 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:39:19.754090 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:39:19.754090 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:39:19.754090 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:39:19.754090 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:39:19.754090 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:39:19.754090 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:39:19.754090 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:39:19.754090 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:39:19.754090 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 14:39:19.754090 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 14:39:19.754090 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 14:39:19.757300 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 14:39:19.757300 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:39:19.757300 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:39:19.757300 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:39:19.757300 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:39:19.757300 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:39:19.757300 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:39:19.757300 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:39:19.757300 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application with Lock( Jul 26 14:39:19.757300 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:39:19.757300 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:39:19.757300 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:39:19.757300 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:39:19.757300 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:39:19.757300 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:39:19.757300 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:39:19.757300 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:39:19.760717 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 14:39:19.760717 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 14:39:19.760717 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 14:39:19.760717 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 14:39:19.760717 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 14:39:19.760717 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 14:39:19.760717 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 14:39:19.760717 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Jul 26 14:39:19.760717 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 441/868] 10.222.0.93 () {56 vars in 1111 bytes} [Tue Jul 26 14:39:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:39:19.760717 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e5921a-1c23-4110-ae7f-74046a560d2c None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:19.787430 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 428/869] 10.222.0.93 () {58 vars in 1023 bytes} [Tue Jul 26 14:39:19 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 14:39:19.799206 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fb213e-5712-4f0c-aeef-9bf3b3f9c45a None None] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:19.919019 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e5921a-1c23-4110-ae7f-74046a560d2c None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:19.967520 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fb213e-5712-4f0c-aeef-9bf3b3f9c45a None None] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:19.988562 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3180d074-619c-4d4e-8034-a83349019881 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:19.989733 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3180d074-619c-4d4e-8034-a83349019881 None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:19.990223 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3180d074-619c-4d4e-8034-a83349019881 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:19.990737 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3180d074-619c-4d4e-8034-a83349019881 None admin] PATH_INFO: `/v3/services` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:19.992019 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3180d074-619c-4d4e-8034-a83349019881 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=87056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:39:19.992570 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3180d074-619c-4d4e-8034-a83349019881 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:19.995281 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3180d074-619c-4d4e-8034-a83349019881 None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:20.004073 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 442/870] 10.222.0.93 () {56 vars in 1126 bytes} [Tue Jul 26 14:39:19 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:39:20.006092 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3180d074-619c-4d4e-8034-a83349019881 None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:20.026947 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1458da-32fb-4441-b1a0-c7ed017cbad3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:20.028566 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1458da-32fb-4441-b1a0-c7ed017cbad3 None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:20.029160 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1458da-32fb-4441-b1a0-c7ed017cbad3 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:20.029691 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1458da-32fb-4441-b1a0-c7ed017cbad3 None admin] PATH_INFO: `/v3/projects` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:20.031212 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1458da-32fb-4441-b1a0-c7ed017cbad3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:39:20.032195 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1458da-32fb-4441-b1a0-c7ed017cbad3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:20.035001 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1458da-32fb-4441-b1a0-c7ed017cbad3 None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:20.062302 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 429/871] 10.222.0.93 () {56 vars in 1148 bytes} [Tue Jul 26 14:39:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:39:20.065943 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1458da-32fb-4441-b1a0-c7ed017cbad3 None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:20.101021 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:20.132417 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:20.217500 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3180d074-619c-4d4e-8034-a83349019881 None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:20.289137 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2843cd2f-8dda-447f-8c1a-22be19a5261a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:20.290499 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2843cd2f-8dda-447f-8c1a-22be19a5261a None admin] REQUEST_METHOD: `POST` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:20.291158 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2843cd2f-8dda-447f-8c1a-22be19a5261a None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:20.291858 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2843cd2f-8dda-447f-8c1a-22be19a5261a None admin] PATH_INFO: `/v3/services` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:20.293146 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2843cd2f-8dda-447f-8c1a-22be19a5261a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:20.295486 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2843cd2f-8dda-447f-8c1a-22be19a5261a None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:20.299859 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1458da-32fb-4441-b1a0-c7ed017cbad3 None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:20.367818 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450410ff-ff7e-4c5a-b53c-e7632f6c2266 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:20.368995 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450410ff-ff7e-4c5a-b53c-e7632f6c2266 None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:20.369531 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450410ff-ff7e-4c5a-b53c-e7632f6c2266 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:20.370208 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450410ff-ff7e-4c5a-b53c-e7632f6c2266 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:20.372018 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450410ff-ff7e-4c5a-b53c-e7632f6c2266 None admin] RBAC: Adding query filter params (role.id=94e105ff8ee4486abd501415cc05ba38, scope.project.id=c422a2290a14424da20e2841cbc1741d, user.id=b914b2ba87e74def85f9694e1141e00b) {{(pid=87055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:39:20.372581 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450410ff-ff7e-4c5a-b53c-e7632f6c2266 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:20.375381 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450410ff-ff7e-4c5a-b53c-e7632f6c2266 None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:20.387903 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 430/872] 10.222.0.93 () {56 vars in 1374 bytes} [Tue Jul 26 14:39:20 2022] GET /identity/v3/role_assignments?user.id=b914b2ba87e74def85f9694e1141e00b&scope.project.id=c422a2290a14424da20e2841cbc1741d&role.id=94e105ff8ee4486abd501415cc05ba38 => generated 608 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:39:20.434142 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 443/873] 10.222.0.93 () {60 vars in 1141 bytes} [Tue Jul 26 14:39:20 2022] POST /identity/v3/services => generated 251 bytes in 429 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 14:39:21.140242 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a132ea-cc0d-4834-a00a-9592da5942f8 None None] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:21.140737 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a132ea-cc0d-4834-a00a-9592da5942f8 None None] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:21.141200 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a132ea-cc0d-4834-a00a-9592da5942f8 None None] PATH_INFO: `/` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:21.144198 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 431/874] 10.222.0.93 () {54 vars in 926 bytes} [Tue Jul 26 14:39:21 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:39:21.154121 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a197bb61-a310-4638-b2b9-b8703192d8d5 None None] REQUEST_METHOD: `POST` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:21.154885 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a197bb61-a310-4638-b2b9-b8703192d8d5 None None] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:21.155293 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a197bb61-a310-4638-b2b9-b8703192d8d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:21.187315 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.auth.core [None req-a197bb61-a310-4638-b2b9-b8703192d8d5 None None] MFA Rules not processed for user `e5ef88cc058f425b882bcb87a1e1e75c`. Rule list: `[]` (Enabled: `True`). {{(pid=87056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:39:21.189353 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.fernet_utils [None req-a197bb61-a310-4638-b2b9-b8703192d8d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:39:21.330093 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 444/875] 10.222.0.93 () {58 vars in 1023 bytes} [Tue Jul 26 14:39:21 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 14:39:21.369214 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a132ea-cc0d-4834-a00a-9592da5942f8 None None] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:21.552938 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:21.573091 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a132ea-cc0d-4834-a00a-9592da5942f8 None None] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:21.618413 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2ab727-0bb8-4820-bf54-3035015ab8b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:21.619502 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2ab727-0bb8-4820-bf54-3035015ab8b7 None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:21.619993 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2ab727-0bb8-4820-bf54-3035015ab8b7 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:21.620476 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2ab727-0bb8-4820-bf54-3035015ab8b7 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:21.634737 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2ab727-0bb8-4820-bf54-3035015ab8b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 14:39:21.640346 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application [None req-5e2ab727-0bb8-4820-bf54-3035015ab8b7 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 26 14:39:21.640346 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:39:21.640346 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:39:21.640346 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:39:21.640346 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:39:21.640346 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:39:21.640346 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:39:21.640346 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:39:21.640346 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:39:21.640346 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:39:21.640346 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:39:21.640346 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:39:21.640346 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 14:39:21.640346 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 14:39:21.640346 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 14:39:21.640346 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 14:39:21.641369 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 14:39:21.641369 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 14:39:21.641369 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 14:39:21.641369 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 14:39:21.641369 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:39:21.641369 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:39:21.641369 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:39:21.641369 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:39:21.641369 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:39:21.641369 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:39:21.641369 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:39:21.641369 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application with Lock( Jul 26 14:39:21.641369 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:39:21.641369 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:39:21.641369 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:39:21.641369 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:39:21.642272 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:39:21.642272 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:39:21.642272 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:39:21.642272 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:39:21.642272 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 14:39:21.642272 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 14:39:21.642272 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 14:39:21.642272 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 14:39:21.642272 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 14:39:21.642272 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 14:39:21.642272 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 26 14:39:21.642272 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Jul 26 14:39:21.645905 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 432/876] 10.222.0.93 () {56 vars in 1120 bytes} [Tue Jul 26 14:39:21 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:39:21.655813 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a197bb61-a310-4638-b2b9-b8703192d8d5 None None] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:21.715258 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:21.862735 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a197bb61-a310-4638-b2b9-b8703192d8d5 None None] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:21.930182 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82db328c-1480-4f53-9a10-8a9216872fad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:21.931243 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82db328c-1480-4f53-9a10-8a9216872fad None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:21.931711 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82db328c-1480-4f53-9a10-8a9216872fad None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:21.932199 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82db328c-1480-4f53-9a10-8a9216872fad None admin] PATH_INFO: `/v3/roles` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:21.933536 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82db328c-1480-4f53-9a10-8a9216872fad None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=87056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:39:21.934083 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82db328c-1480-4f53-9a10-8a9216872fad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:21.936663 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82db328c-1480-4f53-9a10-8a9216872fad None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:21.954271 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 445/877] 10.222.0.93 () {56 vars in 1115 bytes} [Tue Jul 26 14:39:21 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:39:21.960916 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2ab727-0bb8-4820-bf54-3035015ab8b7 None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:22.135602 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2ab727-0bb8-4820-bf54-3035015ab8b7 None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:22.205762 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a502936e-2884-4293-9bf7-cf4e3b7ecc35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:22.208087 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a502936e-2884-4293-9bf7-cf4e3b7ecc35 None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:22.208930 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a502936e-2884-4293-9bf7-cf4e3b7ecc35 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:22.209679 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a502936e-2884-4293-9bf7-cf4e3b7ecc35 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:22.230938 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a502936e-2884-4293-9bf7-cf4e3b7ecc35 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:22.234493 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a502936e-2884-4293-9bf7-cf4e3b7ecc35 None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:22.259566 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application [None req-a502936e-2884-4293-9bf7-cf4e3b7ecc35 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:39:22.259566 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:39:22.259566 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:39:22.259566 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:39:22.259566 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:39:22.259566 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:39:22.259566 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:39:22.259566 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:39:22.259566 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:39:22.259566 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:39:22.259566 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:39:22.259566 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:39:22.259566 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 14:39:22.259566 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 14:39:22.259566 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 14:39:22.261340 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 14:39:22.261340 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:39:22.261340 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:39:22.261340 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:39:22.261340 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:39:22.261340 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:39:22.261340 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:39:22.261340 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:39:22.261340 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application with Lock( Jul 26 14:39:22.261340 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:39:22.261340 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:39:22.261340 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:39:22.261340 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:39:22.261340 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:39:22.261340 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:39:22.261340 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:39:22.261340 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:39:22.263155 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 14:39:22.263155 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 14:39:22.263155 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:39:22.263155 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Jul 26 14:39:22.265892 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 433/878] 10.222.0.93 () {56 vars in 1108 bytes} [Tue Jul 26 14:39:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:39:22.267355 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82db328c-1480-4f53-9a10-8a9216872fad None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:22.469178 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:22.491389 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82db328c-1480-4f53-9a10-8a9216872fad None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:22.564858 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc286d9-998c-4d66-af70-904610997631 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:22.566457 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc286d9-998c-4d66-af70-904610997631 None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:22.568304 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc286d9-998c-4d66-af70-904610997631 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:22.569117 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc286d9-998c-4d66-af70-904610997631 None admin] PATH_INFO: `/v3/domains` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:22.570825 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc286d9-998c-4d66-af70-904610997631 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:39:22.571683 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc286d9-998c-4d66-af70-904610997631 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:22.574678 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc286d9-998c-4d66-af70-904610997631 None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:22.609981 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 446/879] 10.222.0.93 () {56 vars in 1109 bytes} [Tue Jul 26 14:39:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 343 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:39:22.618683 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a502936e-2884-4293-9bf7-cf4e3b7ecc35 None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:22.639615 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39606035-1980-4887-9847-c099faaf89a8 None None] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:22.640025 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39606035-1980-4887-9847-c099faaf89a8 None None] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:22.640180 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39606035-1980-4887-9847-c099faaf89a8 None None] PATH_INFO: `/` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:22.640916 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:22.642575 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 447/880] 10.222.0.93 () {54 vars in 926 bytes} [Tue Jul 26 14:39:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 14:39:22.648773 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfe8fc9-2c53-40ea-8066-879527d20fc5 None None] REQUEST_METHOD: `POST` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:22.649040 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfe8fc9-2c53-40ea-8066-879527d20fc5 None None] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:22.649437 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfe8fc9-2c53-40ea-8066-879527d20fc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:22.678949 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.auth.core [None req-fdfe8fc9-2c53-40ea-8066-879527d20fc5 None None] MFA Rules not processed for user `e5ef88cc058f425b882bcb87a1e1e75c`. Rule list: `[]` (Enabled: `True`). {{(pid=87056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:39:22.681039 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.fernet_utils [None req-fdfe8fc9-2c53-40ea-8066-879527d20fc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:39:22.791570 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a502936e-2884-4293-9bf7-cf4e3b7ecc35 None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:22.841536 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322dcf28-e7fa-4a96-aba7-0184da1d4894 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:22.841918 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 448/881] 10.222.0.93 () {58 vars in 1023 bytes} [Tue Jul 26 14:39:22 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 26 14:39:22.842473 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322dcf28-e7fa-4a96-aba7-0184da1d4894 None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:22.843534 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322dcf28-e7fa-4a96-aba7-0184da1d4894 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:22.843864 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322dcf28-e7fa-4a96-aba7-0184da1d4894 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:22.863059 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322dcf28-e7fa-4a96-aba7-0184da1d4894 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:22.863690 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfe8fc9-2c53-40ea-8066-879527d20fc5 None None] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:22.866647 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322dcf28-e7fa-4a96-aba7-0184da1d4894 None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:22.890960 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application [None req-322dcf28-e7fa-4a96-aba7-0184da1d4894 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 26 14:39:22.890960 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:39:22.890960 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:39:22.890960 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:39:22.890960 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:39:22.890960 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:39:22.890960 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:39:22.890960 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:39:22.890960 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:39:22.890960 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:39:22.890960 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:39:22.890960 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:39:22.890960 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 14:39:22.890960 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 14:39:22.890960 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 14:39:22.890960 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 14:39:22.892726 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:39:22.892726 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:39:22.892726 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 14:39:22.892726 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 14:39:22.892726 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 14:39:22.892726 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 14:39:22.892726 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:39:22.892726 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:39:22.892726 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:39:22.892726 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:39:22.892726 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:39:22.892726 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application with Lock( Jul 26 14:39:22.892726 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:39:22.892726 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:39:22.892726 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:39:22.892726 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:39:22.892726 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:39:22.892726 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:39:22.895860 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:39:22.895860 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:39:22.895860 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 14:39:22.895860 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 14:39:22.895860 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 14:39:22.895860 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 14:39:22.895860 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 14:39:22.895860 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 14:39:22.895860 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 26 14:39:22.895860 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Jul 26 14:39:22.895860 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 434/882] 10.222.0.93 () {56 vars in 1117 bytes} [Tue Jul 26 14:39:22 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:39:22.906920 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322dcf28-e7fa-4a96-aba7-0184da1d4894 None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:22.971854 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:22.997063 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfe8fc9-2c53-40ea-8066-879527d20fc5 None None] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:23.042440 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:23.064826 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95126a7-1ec3-4101-8007-57b39ef66961 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:23.064826 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95126a7-1ec3-4101-8007-57b39ef66961 None admin] REQUEST_METHOD: `POST` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:23.065237 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95126a7-1ec3-4101-8007-57b39ef66961 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:23.065592 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95126a7-1ec3-4101-8007-57b39ef66961 None admin] PATH_INFO: `/v3/services` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:23.066030 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95126a7-1ec3-4101-8007-57b39ef66961 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:23.067739 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95126a7-1ec3-4101-8007-57b39ef66961 None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:23.132400 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322dcf28-e7fa-4a96-aba7-0184da1d4894 None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:23.152031 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 449/883] 10.222.0.93 () {60 vars in 1141 bytes} [Tue Jul 26 14:39:22 2022] POST /identity/v3/services => generated 269 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 14:39:23.170496 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7a9dc7-343e-49ed-b520-d666414f2fcb None None] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:23.171517 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7a9dc7-343e-49ed-b520-d666414f2fcb None None] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:23.172192 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7a9dc7-343e-49ed-b520-d666414f2fcb None None] PATH_INFO: `/` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:23.174706 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 450/884] 10.222.0.93 () {54 vars in 926 bytes} [Tue Jul 26 14:39:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:39:23.182761 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d871ca-32f6-4580-be39-ad871f7110a4 None None] REQUEST_METHOD: `POST` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:23.182761 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d871ca-32f6-4580-be39-ad871f7110a4 None None] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:23.182761 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d871ca-32f6-4580-be39-ad871f7110a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:23.206562 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.auth.core [None req-38d871ca-32f6-4580-be39-ad871f7110a4 None None] MFA Rules not processed for user `e5ef88cc058f425b882bcb87a1e1e75c`. Rule list: `[]` (Enabled: `True`). {{(pid=87056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:39:23.208669 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.fernet_utils [None req-38d871ca-32f6-4580-be39-ad871f7110a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:39:23.225722 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fae6295-8386-44af-bf85-bed5e65e72e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:23.226923 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fae6295-8386-44af-bf85-bed5e65e72e3 None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:23.227407 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fae6295-8386-44af-bf85-bed5e65e72e3 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:23.227869 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fae6295-8386-44af-bf85-bed5e65e72e3 None admin] PATH_INFO: `/v3/users` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:23.230140 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fae6295-8386-44af-bf85-bed5e65e72e3 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=87055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:39:23.230748 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fae6295-8386-44af-bf85-bed5e65e72e3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:23.233922 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fae6295-8386-44af-bf85-bed5e65e72e3 None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:23.283615 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 435/885] 10.222.0.93 () {56 vars in 1149 bytes} [Tue Jul 26 14:39:22 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 373 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:39:23.289157 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fae6295-8386-44af-bf85-bed5e65e72e3 None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:23.317454 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 451/886] 10.222.0.93 () {58 vars in 1023 bytes} [Tue Jul 26 14:39:23 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 26 14:39:23.344512 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d871ca-32f6-4580-be39-ad871f7110a4 None None] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:23.460656 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:23.482229 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fae6295-8386-44af-bf85-bed5e65e72e3 None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:23.507375 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:23.512233 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d871ca-32f6-4580-be39-ad871f7110a4 None None] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:23.542483 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fe3ac9-3dca-4585-8e03-e08dc162dd13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:23.543518 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fe3ac9-3dca-4585-8e03-e08dc162dd13 None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:23.543996 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fe3ac9-3dca-4585-8e03-e08dc162dd13 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:23.544468 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fe3ac9-3dca-4585-8e03-e08dc162dd13 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:23.573194 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7da1e7-f7fc-42a6-83f2-3505d4fe58ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:23.574003 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7da1e7-f7fc-42a6-83f2-3505d4fe58ce None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:23.574482 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7da1e7-f7fc-42a6-83f2-3505d4fe58ce None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:23.574917 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7da1e7-f7fc-42a6-83f2-3505d4fe58ce None admin] PATH_INFO: `/v3/services/object-store` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:23.575831 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7da1e7-f7fc-42a6-83f2-3505d4fe58ce None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:23.577576 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7da1e7-f7fc-42a6-83f2-3505d4fe58ce None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:23.589564 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application [None req-df7da1e7-f7fc-42a6-83f2-3505d4fe58ce None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 26 14:39:23.589564 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:39:23.589564 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 14:39:23.589564 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 14:39:23.589564 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 14:39:23.589564 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 14:39:23.589564 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 14:39:23.589564 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 14:39:23.589564 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 26 14:39:23.589564 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Jul 26 14:39:23.589564 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 14:39:23.589564 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Jul 26 14:39:23.589564 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:39:23.589564 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:39:23.589564 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:39:23.589564 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:39:23.589564 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:39:23.591599 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:39:23.591599 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:39:23.591599 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:39:23.591599 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:39:23.591599 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:39:23.591599 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:39:23.591599 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 14:39:23.591599 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 14:39:23.591599 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 14:39:23.591599 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 14:39:23.591599 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:39:23.591599 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:39:23.591599 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:39:23.591599 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:39:23.591599 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:39:23.591599 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:39:23.593286 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:39:23.593286 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application with Lock( Jul 26 14:39:23.593286 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:39:23.593286 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:39:23.593286 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:39:23.593286 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:39:23.593286 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:39:23.593286 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:39:23.593286 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:39:23.593286 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:39:23.593286 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 14:39:23.593286 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 14:39:23.593286 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 26 14:39:23.593286 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Jul 26 14:39:23.593286 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 452/887] 10.222.0.93 () {56 vars in 1126 bytes} [Tue Jul 26 14:39:23 2022] GET /identity/v3/services/object-store => generated 93 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:39:23.596589 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf439987-9730-42b3-bdb1-dd29c7398f31 None None] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:23.596589 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf439987-9730-42b3-bdb1-dd29c7398f31 None None] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:23.596589 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf439987-9730-42b3-bdb1-dd29c7398f31 None None] PATH_INFO: `/` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:23.603029 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 453/888] 10.222.0.93 () {54 vars in 926 bytes} [Tue Jul 26 14:39:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:39:23.603029 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf439987-9730-42b3-bdb1-dd29c7398f31 None None] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:23.688398 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fe3ac9-3dca-4585-8e03-e08dc162dd13 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:23.690646 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fe3ac9-3dca-4585-8e03-e08dc162dd13 None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:23.798898 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf439987-9730-42b3-bdb1-dd29c7398f31 None None] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:23.866039 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ed837f-5a63-4f4d-b07b-466862dcf5e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:23.867133 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ed837f-5a63-4f4d-b07b-466862dcf5e0 None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:23.867625 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ed837f-5a63-4f4d-b07b-466862dcf5e0 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:23.868097 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ed837f-5a63-4f4d-b07b-466862dcf5e0 None admin] PATH_INFO: `/v3/services` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:23.869265 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ed837f-5a63-4f4d-b07b-466862dcf5e0 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=87056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:39:23.869788 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ed837f-5a63-4f4d-b07b-466862dcf5e0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:23.872290 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ed837f-5a63-4f4d-b07b-466862dcf5e0 None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:23.874637 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:23.880906 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 454/889] 10.222.0.93 () {56 vars in 1122 bytes} [Tue Jul 26 14:39:23 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:39:23.881965 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cdd744-4714-4785-a9e1-9f705e796775 None None] REQUEST_METHOD: `POST` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:23.882314 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cdd744-4714-4785-a9e1-9f705e796775 None None] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:23.882543 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cdd744-4714-4785-a9e1-9f705e796775 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:23.897150 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 436/890] 10.222.0.93 () {58 vars in 1282 bytes} [Tue Jul 26 14:39:23 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 609 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 26 14:39:23.900010 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fe3ac9-3dca-4585-8e03-e08dc162dd13 None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:23.904157 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.auth.core [None req-58cdd744-4714-4785-a9e1-9f705e796775 None None] MFA Rules not processed for user `e5ef88cc058f425b882bcb87a1e1e75c`. Rule list: `[]` (Enabled: `True`). {{(pid=87056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:39:23.906295 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.fernet_utils [None req-58cdd744-4714-4785-a9e1-9f705e796775 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:39:23.935828 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:24.046640 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 455/891] 10.222.0.93 () {58 vars in 1023 bytes} [Tue Jul 26 14:39:23 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 14:39:24.048331 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cdd744-4714-4785-a9e1-9f705e796775 None None] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:24.108990 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fe3ac9-3dca-4585-8e03-e08dc162dd13 None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:24.165695 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ca719d-be62-452b-a413-5a85148b6897 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:24.166369 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ca719d-be62-452b-a413-5a85148b6897 None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:24.166662 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ca719d-be62-452b-a413-5a85148b6897 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:24.166946 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ca719d-be62-452b-a413-5a85148b6897 None admin] PATH_INFO: `/v3/services` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:24.167656 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ca719d-be62-452b-a413-5a85148b6897 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=87055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:39:24.167968 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ca719d-be62-452b-a413-5a85148b6897 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:24.169379 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ca719d-be62-452b-a413-5a85148b6897 None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:24.186284 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 437/892] 10.222.0.93 () {56 vars in 1122 bytes} [Tue Jul 26 14:39:23 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:39:24.186284 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ca719d-be62-452b-a413-5a85148b6897 None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:24.286512 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cdd744-4714-4785-a9e1-9f705e796775 None None] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:24.338335 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:24.339349 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:24.352147 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fb82a3-9fc5-4bc2-a083-620ff6b1c925 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:24.353407 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fb82a3-9fc5-4bc2-a083-620ff6b1c925 None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:24.354070 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fb82a3-9fc5-4bc2-a083-620ff6b1c925 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:24.357321 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fb82a3-9fc5-4bc2-a083-620ff6b1c925 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:24.373939 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ca719d-be62-452b-a413-5a85148b6897 None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:24.380872 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fb82a3-9fc5-4bc2-a083-620ff6b1c925 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:24.382634 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fb82a3-9fc5-4bc2-a083-620ff6b1c925 None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:24.413257 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application [None req-59fb82a3-9fc5-4bc2-a083-620ff6b1c925 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:39:24.413257 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:39:24.413257 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:39:24.413257 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:39:24.413257 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:39:24.413257 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:39:24.413257 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:39:24.413257 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:39:24.413257 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:39:24.413257 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:39:24.413257 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:39:24.413257 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:39:24.413257 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 14:39:24.413257 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 14:39:24.413257 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 14:39:24.415304 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 14:39:24.415304 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:39:24.415304 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:39:24.415304 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:39:24.415304 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:39:24.415304 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:39:24.415304 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:39:24.415304 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:39:24.415304 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application with Lock( Jul 26 14:39:24.415304 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:39:24.415304 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:39:24.415304 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:39:24.415304 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:39:24.415304 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:39:24.415304 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:39:24.415304 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:39:24.415304 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:39:24.417455 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 14:39:24.417455 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 14:39:24.417455 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:39:24.417455 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Jul 26 14:39:24.417455 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 456/893] 10.222.0.93 () {56 vars in 1108 bytes} [Tue Jul 26 14:39:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 369 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:39:24.425499 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fb82a3-9fc5-4bc2-a083-620ff6b1c925 None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:24.466426 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1304ad1f-688d-4644-87d9-84ab9c170c2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:24.467953 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1304ad1f-688d-4644-87d9-84ab9c170c2a None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:24.468677 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1304ad1f-688d-4644-87d9-84ab9c170c2a None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:24.469711 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1304ad1f-688d-4644-87d9-84ab9c170c2a None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:24.471150 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1304ad1f-688d-4644-87d9-84ab9c170c2a None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:24.474476 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1304ad1f-688d-4644-87d9-84ab9c170c2a None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:24.496624 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application [None req-1304ad1f-688d-4644-87d9-84ab9c170c2a None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 26 14:39:24.496624 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:39:24.496624 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 14:39:24.496624 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 14:39:24.496624 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 14:39:24.496624 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 14:39:24.496624 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 14:39:24.496624 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 14:39:24.496624 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 26 14:39:24.496624 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Jul 26 14:39:24.496624 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 14:39:24.496624 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Jul 26 14:39:24.496624 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:39:24.496624 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:39:24.496624 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:39:24.496624 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:39:24.496624 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:39:24.498818 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:39:24.498818 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:39:24.498818 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:39:24.498818 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:39:24.498818 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:39:24.498818 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:39:24.498818 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 14:39:24.498818 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 14:39:24.498818 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 14:39:24.498818 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 14:39:24.498818 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:39:24.498818 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:39:24.498818 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:39:24.498818 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:39:24.498818 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:39:24.498818 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:39:24.500435 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:39:24.500435 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application with Lock( Jul 26 14:39:24.500435 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:39:24.500435 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:39:24.500435 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:39:24.500435 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:39:24.500435 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:39:24.500435 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:39:24.500435 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:39:24.500435 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:39:24.500435 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 14:39:24.500435 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 14:39:24.500435 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 26 14:39:24.500435 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Jul 26 14:39:24.505092 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 438/894] 10.222.0.93 () {56 vars in 1114 bytes} [Tue Jul 26 14:39:24 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 330 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:39:24.516472 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1304ad1f-688d-4644-87d9-84ab9c170c2a None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:24.602958 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fb82a3-9fc5-4bc2-a083-620ff6b1c925 None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:24.674121 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b365cd-87a8-440f-8b87-247058d7ea67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:24.675684 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b365cd-87a8-440f-8b87-247058d7ea67 None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:24.676490 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b365cd-87a8-440f-8b87-247058d7ea67 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:24.677340 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b365cd-87a8-440f-8b87-247058d7ea67 None admin] PATH_INFO: `/v3/domains` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:24.678933 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b365cd-87a8-440f-8b87-247058d7ea67 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:39:24.679749 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b365cd-87a8-440f-8b87-247058d7ea67 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:24.682655 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b365cd-87a8-440f-8b87-247058d7ea67 None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:24.711414 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 457/895] 10.222.0.93 () {56 vars in 1109 bytes} [Tue Jul 26 14:39:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:39:24.718398 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b365cd-87a8-440f-8b87-247058d7ea67 None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:24.722652 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1304ad1f-688d-4644-87d9-84ab9c170c2a None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:24.779269 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:24.807290 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec2feee-eb01-4758-b43b-04e2daae1ab8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:24.809108 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec2feee-eb01-4758-b43b-04e2daae1ab8 None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:24.810204 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec2feee-eb01-4758-b43b-04e2daae1ab8 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:24.810936 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec2feee-eb01-4758-b43b-04e2daae1ab8 None admin] PATH_INFO: `/v3/services` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:24.812208 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec2feee-eb01-4758-b43b-04e2daae1ab8 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=87055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:39:24.813625 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec2feee-eb01-4758-b43b-04e2daae1ab8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:24.821053 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec2feee-eb01-4758-b43b-04e2daae1ab8 None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:24.837690 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 439/896] 10.222.0.93 () {56 vars in 1114 bytes} [Tue Jul 26 14:39:24 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:39:24.843209 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec2feee-eb01-4758-b43b-04e2daae1ab8 None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:24.870686 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:24.891566 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b365cd-87a8-440f-8b87-247058d7ea67 None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:24.963290 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b02d79-113f-40c8-82e2-21b72f7295da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:24.964780 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b02d79-113f-40c8-82e2-21b72f7295da None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:24.965403 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b02d79-113f-40c8-82e2-21b72f7295da None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:24.966005 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b02d79-113f-40c8-82e2-21b72f7295da None admin] PATH_INFO: `/v3/projects/service` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:24.981142 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b02d79-113f-40c8-82e2-21b72f7295da None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:24.984507 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b02d79-113f-40c8-82e2-21b72f7295da None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:24.986991 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec2feee-eb01-4758-b43b-04e2daae1ab8 None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:25.010023 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application [None req-f2b02d79-113f-40c8-82e2-21b72f7295da None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 14:39:25.010023 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:39:25.010023 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:39:25.010023 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:39:25.010023 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:39:25.010023 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:39:25.010023 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:39:25.010023 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:39:25.010023 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:39:25.010023 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:39:25.010023 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:39:25.010023 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:39:25.010023 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 14:39:25.010023 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 14:39:25.010023 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 14:39:25.011975 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 14:39:25.011975 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:39:25.011975 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:39:25.011975 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:39:25.011975 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:39:25.011975 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:39:25.011975 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:39:25.011975 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:39:25.011975 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application with Lock( Jul 26 14:39:25.011975 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:39:25.011975 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:39:25.011975 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:39:25.011975 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:39:25.011975 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:39:25.011975 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:39:25.011975 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:39:25.011975 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:39:25.014014 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 14:39:25.014014 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 14:39:25.014014 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 14:39:25.014014 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 14:39:25.014014 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 14:39:25.014014 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 14:39:25.014014 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 14:39:25.014014 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Jul 26 14:39:25.025760 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 458/897] 10.222.0.93 () {56 vars in 1111 bytes} [Tue Jul 26 14:39:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:39:25.027936 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b02d79-113f-40c8-82e2-21b72f7295da None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:25.028908 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a228b5dc-2032-49dc-a7e2-178c9b52b43e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:25.029682 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a228b5dc-2032-49dc-a7e2-178c9b52b43e None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:25.030012 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a228b5dc-2032-49dc-a7e2-178c9b52b43e None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:25.030410 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a228b5dc-2032-49dc-a7e2-178c9b52b43e None admin] PATH_INFO: `/v3/services` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:25.031255 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a228b5dc-2032-49dc-a7e2-178c9b52b43e None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=87055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:39:25.031900 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a228b5dc-2032-49dc-a7e2-178c9b52b43e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:25.033426 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a228b5dc-2032-49dc-a7e2-178c9b52b43e None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:25.040463 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 440/898] 10.222.0.93 () {56 vars in 1114 bytes} [Tue Jul 26 14:39:24 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:39:25.046496 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a228b5dc-2032-49dc-a7e2-178c9b52b43e None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:25.166162 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:25.201630 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a228b5dc-2032-49dc-a7e2-178c9b52b43e None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:25.232415 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:25.238182 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b02d79-113f-40c8-82e2-21b72f7295da None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:25.246149 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7e9391-1f85-4e53-ab34-a86925e448ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:25.247107 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7e9391-1f85-4e53-ab34-a86925e448ca None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:25.247609 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7e9391-1f85-4e53-ab34-a86925e448ca None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:25.248090 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7e9391-1f85-4e53-ab34-a86925e448ca None admin] PATH_INFO: `/v3/endpoints` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:25.249175 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7e9391-1f85-4e53-ab34-a86925e448ca None admin] RBAC: Adding query filter params (interface=public, service_id=684f1b4d03794c928400158111d87fb7, region_id=RegionOne) {{(pid=87055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:39:25.249729 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7e9391-1f85-4e53-ab34-a86925e448ca None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:25.251380 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7e9391-1f85-4e53-ab34-a86925e448ca None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:25.259269 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 441/899] 10.222.0.93 () {56 vars in 1251 bytes} [Tue Jul 26 14:39:25 2022] GET /identity/v3/endpoints?service_id=684f1b4d03794c928400158111d87fb7&interface=public®ion_id=RegionOne => generated 194 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:39:25.272454 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7e9391-1f85-4e53-ab34-a86925e448ca None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:25.318591 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961f25ec-fcfc-4669-82eb-c34d2e50a723 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:25.319727 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961f25ec-fcfc-4669-82eb-c34d2e50a723 None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:25.320239 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961f25ec-fcfc-4669-82eb-c34d2e50a723 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:25.320754 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961f25ec-fcfc-4669-82eb-c34d2e50a723 None admin] PATH_INFO: `/v3/projects` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:25.322545 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961f25ec-fcfc-4669-82eb-c34d2e50a723 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:39:25.323067 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961f25ec-fcfc-4669-82eb-c34d2e50a723 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:25.326142 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961f25ec-fcfc-4669-82eb-c34d2e50a723 None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:25.362644 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 459/900] 10.222.0.93 () {56 vars in 1148 bytes} [Tue Jul 26 14:39:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:39:25.365733 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961f25ec-fcfc-4669-82eb-c34d2e50a723 None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:25.435619 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7e9391-1f85-4e53-ab34-a86925e448ca None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:25.507781 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649e171f-6eaf-4842-ae18-0983e9716a64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:25.509229 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649e171f-6eaf-4842-ae18-0983e9716a64 None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:25.509726 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649e171f-6eaf-4842-ae18-0983e9716a64 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:25.510592 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649e171f-6eaf-4842-ae18-0983e9716a64 None admin] PATH_INFO: `/v3/services` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:25.512920 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649e171f-6eaf-4842-ae18-0983e9716a64 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:25.514408 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961f25ec-fcfc-4669-82eb-c34d2e50a723 None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:25.515232 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649e171f-6eaf-4842-ae18-0983e9716a64 None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:25.519621 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:25.528648 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 442/901] 10.222.0.93 () {56 vars in 1087 bytes} [Tue Jul 26 14:39:25 2022] GET /identity/v3/services => generated 1268 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 14:39:25.588769 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dda7d2c-0e59-4c0d-b6a9-0f8825d2dc7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:25.589891 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dda7d2c-0e59-4c0d-b6a9-0f8825d2dc7c None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:25.590440 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dda7d2c-0e59-4c0d-b6a9-0f8825d2dc7c None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:25.590950 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dda7d2c-0e59-4c0d-b6a9-0f8825d2dc7c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:25.592620 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dda7d2c-0e59-4c0d-b6a9-0f8825d2dc7c None admin] RBAC: Adding query filter params (role.id=fb41e639164e46ba82e91c6a63dd4898, scope.project.id=c422a2290a14424da20e2841cbc1741d, user.id=0205dfcfb5e5404c95aefc1f45a1e1e6) {{(pid=87056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:39:25.593192 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dda7d2c-0e59-4c0d-b6a9-0f8825d2dc7c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:25.596237 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dda7d2c-0e59-4c0d-b6a9-0f8825d2dc7c None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:25.608686 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 460/902] 10.222.0.93 () {56 vars in 1374 bytes} [Tue Jul 26 14:39:25 2022] GET /identity/v3/role_assignments?user.id=0205dfcfb5e5404c95aefc1f45a1e1e6&scope.project.id=c422a2290a14424da20e2841cbc1741d&role.id=fb41e639164e46ba82e91c6a63dd4898 => generated 259 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:39:25.944493 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5193e871-bdae-4583-84e3-343f8635e5c1 None None] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:25.944493 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5193e871-bdae-4583-84e3-343f8635e5c1 None None] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:25.944493 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5193e871-bdae-4583-84e3-343f8635e5c1 None None] PATH_INFO: `/` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:25.945565 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 443/903] 10.222.0.93 () {54 vars in 926 bytes} [Tue Jul 26 14:39:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 14:39:25.951744 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2d095a-caea-4f97-adbb-c88ad4f829cf None None] REQUEST_METHOD: `POST` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:25.952446 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2d095a-caea-4f97-adbb-c88ad4f829cf None None] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:25.952953 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2d095a-caea-4f97-adbb-c88ad4f829cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:25.995632 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.auth.core [None req-6a2d095a-caea-4f97-adbb-c88ad4f829cf None None] MFA Rules not processed for user `e5ef88cc058f425b882bcb87a1e1e75c`. Rule list: `[]` (Enabled: `True`). {{(pid=87056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:39:25.997822 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.fernet_utils [None req-6a2d095a-caea-4f97-adbb-c88ad4f829cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:39:26.035005 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:26.128352 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 461/904] 10.222.0.93 () {58 vars in 1023 bytes} [Tue Jul 26 14:39:25 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 26 14:39:26.152326 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5193e871-bdae-4583-84e3-343f8635e5c1 None None] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:26.336895 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5193e871-bdae-4583-84e3-343f8635e5c1 None None] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:26.397406 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba48dcc1-7d26-48dd-bb40-9cfb60e9da67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:26.398082 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba48dcc1-7d26-48dd-bb40-9cfb60e9da67 None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:26.398399 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba48dcc1-7d26-48dd-bb40-9cfb60e9da67 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:26.398680 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba48dcc1-7d26-48dd-bb40-9cfb60e9da67 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:26.399338 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba48dcc1-7d26-48dd-bb40-9cfb60e9da67 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:26.400859 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba48dcc1-7d26-48dd-bb40-9cfb60e9da67 None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:26.411815 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application [None req-ba48dcc1-7d26-48dd-bb40-9cfb60e9da67 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 26 14:39:26.411815 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:39:26.411815 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 14:39:26.411815 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 14:39:26.411815 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 14:39:26.411815 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 14:39:26.411815 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 14:39:26.411815 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 14:39:26.411815 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 26 14:39:26.411815 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Jul 26 14:39:26.411815 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 14:39:26.411815 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Jul 26 14:39:26.411815 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:39:26.411815 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:39:26.411815 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:39:26.411815 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:39:26.412831 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:39:26.412831 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:39:26.412831 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:39:26.412831 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:39:26.412831 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:39:26.412831 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:39:26.412831 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:39:26.412831 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 14:39:26.412831 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 14:39:26.412831 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 14:39:26.412831 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 14:39:26.412831 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:39:26.412831 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:39:26.412831 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:39:26.412831 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:39:26.412831 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:39:26.413717 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:39:26.413717 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:39:26.413717 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application with Lock( Jul 26 14:39:26.413717 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:39:26.413717 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:39:26.413717 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:39:26.413717 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:39:26.413717 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:39:26.413717 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:39:26.413717 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:39:26.413717 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:39:26.413717 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 14:39:26.413717 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 14:39:26.413717 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 26 14:39:26.413717 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Jul 26 14:39:26.413717 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 444/905] 10.222.0.93 () {56 vars in 1132 bytes} [Tue Jul 26 14:39:26 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:39:26.421443 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2d095a-caea-4f97-adbb-c88ad4f829cf None None] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:26.609801 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2d095a-caea-4f97-adbb-c88ad4f829cf None None] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:26.684141 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8866d84-b2c0-4e4b-bf81-ab421a05d960 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:26.685183 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8866d84-b2c0-4e4b-bf81-ab421a05d960 None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:26.685679 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8866d84-b2c0-4e4b-bf81-ab421a05d960 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:26.686169 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8866d84-b2c0-4e4b-bf81-ab421a05d960 None admin] PATH_INFO: `/v3/services` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:26.689478 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8866d84-b2c0-4e4b-bf81-ab421a05d960 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=87056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:39:26.689478 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8866d84-b2c0-4e4b-bf81-ab421a05d960 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:26.690686 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8866d84-b2c0-4e4b-bf81-ab421a05d960 None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:26.700930 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 462/906] 10.222.0.93 () {56 vars in 1126 bytes} [Tue Jul 26 14:39:26 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:39:26.706399 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba48dcc1-7d26-48dd-bb40-9cfb60e9da67 None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:26.783390 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:26.828233 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba48dcc1-7d26-48dd-bb40-9cfb60e9da67 None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:26.872169 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca5364e-7262-42b2-8404-212f80394da9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:26.872730 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca5364e-7262-42b2-8404-212f80394da9 None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:26.873016 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca5364e-7262-42b2-8404-212f80394da9 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:26.873296 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca5364e-7262-42b2-8404-212f80394da9 None admin] PATH_INFO: `/v3/services` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:26.873989 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca5364e-7262-42b2-8404-212f80394da9 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=87055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:39:26.874328 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca5364e-7262-42b2-8404-212f80394da9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:26.875799 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca5364e-7262-42b2-8404-212f80394da9 None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:26.882552 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 445/907] 10.222.0.93 () {56 vars in 1126 bytes} [Tue Jul 26 14:39:26 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:39:26.888847 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8866d84-b2c0-4e4b-bf81-ab421a05d960 None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:26.916735 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:27.070145 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8866d84-b2c0-4e4b-bf81-ab421a05d960 None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:27.117899 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee70319-c4d2-4144-833f-519d969c20b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:27.118828 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee70319-c4d2-4144-833f-519d969c20b2 None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:27.119117 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee70319-c4d2-4144-833f-519d969c20b2 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:27.119447 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee70319-c4d2-4144-833f-519d969c20b2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:27.120331 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee70319-c4d2-4144-833f-519d969c20b2 None admin] RBAC: Adding query filter params (interface=public, service_id=853c600e88874aae9c93499237225b18, region_id=RegionOne) {{(pid=87056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:39:27.120681 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee70319-c4d2-4144-833f-519d969c20b2 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:27.122297 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee70319-c4d2-4144-833f-519d969c20b2 None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:27.130173 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 463/908] 10.222.0.93 () {56 vars in 1251 bytes} [Tue Jul 26 14:39:26 2022] GET /identity/v3/endpoints?service_id=853c600e88874aae9c93499237225b18&interface=public®ion_id=RegionOne => generated 194 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:39:27.139974 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca5364e-7262-42b2-8404-212f80394da9 None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:27.178663 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dc49d8-3767-4ecd-aae2-b9b5c1b73d10 None None] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:27.179117 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dc49d8-3767-4ecd-aae2-b9b5c1b73d10 None None] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:27.179576 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dc49d8-3767-4ecd-aae2-b9b5c1b73d10 None None] PATH_INFO: `/` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:27.189113 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 464/909] 10.222.0.93 () {54 vars in 926 bytes} [Tue Jul 26 14:39:27 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 14:39:27.192690 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5294b8f0-b3fc-42e6-b61f-9aad26767e19 None None] REQUEST_METHOD: `POST` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:27.193178 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5294b8f0-b3fc-42e6-b61f-9aad26767e19 None None] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:27.193609 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5294b8f0-b3fc-42e6-b61f-9aad26767e19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:27.226712 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.auth.core [None req-5294b8f0-b3fc-42e6-b61f-9aad26767e19 None None] MFA Rules not processed for user `e5ef88cc058f425b882bcb87a1e1e75c`. Rule list: `[]` (Enabled: `True`). {{(pid=87056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:39:27.228768 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.fernet_utils [None req-5294b8f0-b3fc-42e6-b61f-9aad26767e19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:39:27.346981 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca5364e-7262-42b2-8404-212f80394da9 None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:27.376304 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 465/910] 10.222.0.93 () {58 vars in 1023 bytes} [Tue Jul 26 14:39:27 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 26 14:39:27.401665 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:27.417741 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5294b8f0-b3fc-42e6-b61f-9aad26767e19 None None] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:27.433326 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893d8302-10c5-4f31-98b4-958eabf044e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:27.433326 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893d8302-10c5-4f31-98b4-958eabf044e3 None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:27.433326 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893d8302-10c5-4f31-98b4-958eabf044e3 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:27.433326 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893d8302-10c5-4f31-98b4-958eabf044e3 None admin] PATH_INFO: `/v3/services` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:27.433712 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893d8302-10c5-4f31-98b4-958eabf044e3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:27.433712 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893d8302-10c5-4f31-98b4-958eabf044e3 None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:27.438763 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 446/911] 10.222.0.93 () {56 vars in 1087 bytes} [Tue Jul 26 14:39:27 2022] GET /identity/v3/services => generated 1268 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 14:39:27.459740 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:27.616095 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5294b8f0-b3fc-42e6-b61f-9aad26767e19 None None] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:27.681544 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028a22f0-fe61-467e-b4a5-d9074ffae93a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:27.682530 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028a22f0-fe61-467e-b4a5-d9074ffae93a None admin] REQUEST_METHOD: `POST` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:27.682992 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028a22f0-fe61-467e-b4a5-d9074ffae93a None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:27.683449 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028a22f0-fe61-467e-b4a5-d9074ffae93a None admin] PATH_INFO: `/v3/services` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:27.684701 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028a22f0-fe61-467e-b4a5-d9074ffae93a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:27.687260 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028a22f0-fe61-467e-b4a5-d9074ffae93a None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:27.870418 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 466/912] 10.222.0.93 () {60 vars in 1141 bytes} [Tue Jul 26 14:39:27 2022] POST /identity/v3/services => generated 241 bytes in 452 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 14:39:27.955971 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3537eea-2338-4b0a-bea9-8f2182f58897 None None] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:27.956403 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3537eea-2338-4b0a-bea9-8f2182f58897 None None] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:27.956774 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3537eea-2338-4b0a-bea9-8f2182f58897 None None] PATH_INFO: `/` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:27.958974 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 447/913] 10.222.0.93 () {54 vars in 926 bytes} [Tue Jul 26 14:39:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:39:27.967397 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb32c6ee-52f8-44ae-ad83-02fe28382ab1 None None] REQUEST_METHOD: `POST` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:27.968085 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb32c6ee-52f8-44ae-ad83-02fe28382ab1 None None] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:27.968576 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb32c6ee-52f8-44ae-ad83-02fe28382ab1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:27.999324 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.auth.core [None req-eb32c6ee-52f8-44ae-ad83-02fe28382ab1 None None] MFA Rules not processed for user `e5ef88cc058f425b882bcb87a1e1e75c`. Rule list: `[]` (Enabled: `True`). {{(pid=87056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:39:28.001561 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.fernet_utils [None req-eb32c6ee-52f8-44ae-ad83-02fe28382ab1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:39:28.136050 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:28.148091 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 467/914] 10.222.0.93 () {58 vars in 1023 bytes} [Tue Jul 26 14:39:27 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 14:39:28.173030 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3537eea-2338-4b0a-bea9-8f2182f58897 None None] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:28.297875 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fb8cbe-e54e-495f-87f4-27ba6834169a None None] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:28.298868 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fb8cbe-e54e-495f-87f4-27ba6834169a None None] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:28.299706 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fb8cbe-e54e-495f-87f4-27ba6834169a None None] PATH_INFO: `/` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:28.310809 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 468/915] 10.222.0.93 () {54 vars in 926 bytes} [Tue Jul 26 14:39:28 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:39:28.314351 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6884e0f6-98da-418d-b420-35ce8c7053a1 None None] REQUEST_METHOD: `POST` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:28.315277 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6884e0f6-98da-418d-b420-35ce8c7053a1 None None] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:28.316211 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6884e0f6-98da-418d-b420-35ce8c7053a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:28.351257 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.auth.core [None req-6884e0f6-98da-418d-b420-35ce8c7053a1 None None] MFA Rules not processed for user `e5ef88cc058f425b882bcb87a1e1e75c`. Rule list: `[]` (Enabled: `True`). {{(pid=87056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:39:28.353918 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.fernet_utils [None req-6884e0f6-98da-418d-b420-35ce8c7053a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:39:28.367129 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3537eea-2338-4b0a-bea9-8f2182f58897 None None] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:28.453956 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94b7614-57cc-4f03-86d5-572686542599 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:28.455882 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94b7614-57cc-4f03-86d5-572686542599 None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:28.456662 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94b7614-57cc-4f03-86d5-572686542599 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:28.457945 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94b7614-57cc-4f03-86d5-572686542599 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:28.459669 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94b7614-57cc-4f03-86d5-572686542599 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:28.462818 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94b7614-57cc-4f03-86d5-572686542599 None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:28.486454 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application [None req-d94b7614-57cc-4f03-86d5-572686542599 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 26 14:39:28.486454 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:39:28.486454 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 14:39:28.486454 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 14:39:28.486454 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 14:39:28.486454 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 14:39:28.486454 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 14:39:28.486454 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 14:39:28.486454 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 26 14:39:28.486454 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Jul 26 14:39:28.486454 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 14:39:28.486454 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Jul 26 14:39:28.486454 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:39:28.486454 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:39:28.486454 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:39:28.486454 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:39:28.486454 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:39:28.489127 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:39:28.489127 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:39:28.489127 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:39:28.489127 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:39:28.489127 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:39:28.489127 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:39:28.489127 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 14:39:28.489127 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 14:39:28.489127 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 14:39:28.489127 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 14:39:28.489127 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:39:28.489127 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:39:28.489127 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:39:28.489127 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:39:28.489127 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:39:28.489127 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:39:28.492350 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:39:28.492350 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application with Lock( Jul 26 14:39:28.492350 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:39:28.492350 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:39:28.492350 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:39:28.492350 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:39:28.492350 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:39:28.492350 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:39:28.492350 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:39:28.492350 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:39:28.492350 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 14:39:28.492350 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 14:39:28.492350 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 26 14:39:28.492350 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Jul 26 14:39:28.498065 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 448/916] 10.222.0.93 () {56 vars in 1114 bytes} [Tue Jul 26 14:39:28 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 325 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:39:28.508682 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94b7614-57cc-4f03-86d5-572686542599 None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:28.526382 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 469/917] 10.222.0.93 () {58 vars in 1023 bytes} [Tue Jul 26 14:39:28 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 26 14:39:28.548605 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6884e0f6-98da-418d-b420-35ce8c7053a1 None None] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:28.625720 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:28.697221 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94b7614-57cc-4f03-86d5-572686542599 None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:28.751988 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6884e0f6-98da-418d-b420-35ce8c7053a1 None None] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:28.753653 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063dc676-baab-4eb5-b61c-fa1fda230b07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:28.756008 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063dc676-baab-4eb5-b61c-fa1fda230b07 None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:28.756624 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063dc676-baab-4eb5-b61c-fa1fda230b07 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:28.758491 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063dc676-baab-4eb5-b61c-fa1fda230b07 None admin] PATH_INFO: `/v3/services` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:28.759664 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063dc676-baab-4eb5-b61c-fa1fda230b07 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=87055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:39:28.760206 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063dc676-baab-4eb5-b61c-fa1fda230b07 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:28.761832 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063dc676-baab-4eb5-b61c-fa1fda230b07 None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:28.771701 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 449/918] 10.222.0.93 () {56 vars in 1114 bytes} [Tue Jul 26 14:39:28 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:39:28.779622 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063dc676-baab-4eb5-b61c-fa1fda230b07 None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:28.803958 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:28.816202 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f792e6-2d57-47e5-8bb1-bf31028223d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:28.818797 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f792e6-2d57-47e5-8bb1-bf31028223d6 None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:28.819226 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f792e6-2d57-47e5-8bb1-bf31028223d6 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:28.819725 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f792e6-2d57-47e5-8bb1-bf31028223d6 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:28.836318 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f792e6-2d57-47e5-8bb1-bf31028223d6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 14:39:28.843066 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application [None req-d4f792e6-2d57-47e5-8bb1-bf31028223d6 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 26 14:39:28.843066 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:39:28.843066 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:39:28.843066 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:39:28.843066 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:39:28.843066 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:39:28.843066 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:39:28.843066 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:39:28.843066 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:39:28.843066 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:39:28.843066 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:39:28.843066 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:39:28.843066 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 14:39:28.843066 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 14:39:28.843066 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 14:39:28.843066 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 14:39:28.844904 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 14:39:28.844904 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 14:39:28.844904 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 14:39:28.844904 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 14:39:28.844904 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:39:28.844904 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:39:28.844904 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:39:28.844904 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:39:28.844904 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:39:28.844904 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:39:28.844904 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:39:28.844904 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application with Lock( Jul 26 14:39:28.844904 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:39:28.844904 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:39:28.844904 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:39:28.844904 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:39:28.846332 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:39:28.846332 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:39:28.846332 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:39:28.846332 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:39:28.846332 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 14:39:28.846332 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 14:39:28.846332 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 14:39:28.846332 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 14:39:28.846332 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 14:39:28.846332 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 14:39:28.846332 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 26 14:39:28.846332 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Jul 26 14:39:28.856701 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 470/919] 10.222.0.93 () {56 vars in 1120 bytes} [Tue Jul 26 14:39:28 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:39:28.858627 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f792e6-2d57-47e5-8bb1-bf31028223d6 None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:28.993045 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063dc676-baab-4eb5-b61c-fa1fda230b07 None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:29.022282 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:29.039765 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4904520c-a6c6-42f8-a69c-b09c52bff75f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:29.040151 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4904520c-a6c6-42f8-a69c-b09c52bff75f None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:29.040427 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4904520c-a6c6-42f8-a69c-b09c52bff75f None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:29.040708 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4904520c-a6c6-42f8-a69c-b09c52bff75f None admin] PATH_INFO: `/v3/services` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:29.041422 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4904520c-a6c6-42f8-a69c-b09c52bff75f None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=87055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:39:29.041792 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4904520c-a6c6-42f8-a69c-b09c52bff75f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:29.043387 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4904520c-a6c6-42f8-a69c-b09c52bff75f None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:29.045337 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f792e6-2d57-47e5-8bb1-bf31028223d6 None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:29.055250 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 450/920] 10.222.0.93 () {56 vars in 1114 bytes} [Tue Jul 26 14:39:28 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:39:29.062755 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4904520c-a6c6-42f8-a69c-b09c52bff75f None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:29.092775 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79f668b-11f7-46e6-9d51-33a7ac280014 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:29.093457 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79f668b-11f7-46e6-9d51-33a7ac280014 None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:29.093745 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79f668b-11f7-46e6-9d51-33a7ac280014 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:29.094014 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79f668b-11f7-46e6-9d51-33a7ac280014 None admin] PATH_INFO: `/v3/roles` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:29.095409 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79f668b-11f7-46e6-9d51-33a7ac280014 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=87056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:39:29.095409 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79f668b-11f7-46e6-9d51-33a7ac280014 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:29.096608 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79f668b-11f7-46e6-9d51-33a7ac280014 None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:29.111764 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 471/921] 10.222.0.93 () {56 vars in 1115 bytes} [Tue Jul 26 14:39:28 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:39:29.116398 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79f668b-11f7-46e6-9d51-33a7ac280014 None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:29.183588 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:29.222338 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4904520c-a6c6-42f8-a69c-b09c52bff75f None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:29.273702 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687d2cf0-1610-4599-bb85-35b6fe42ed50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:29.274131 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687d2cf0-1610-4599-bb85-35b6fe42ed50 None admin] REQUEST_METHOD: `POST` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:29.274612 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687d2cf0-1610-4599-bb85-35b6fe42ed50 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:29.274967 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687d2cf0-1610-4599-bb85-35b6fe42ed50 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:29.277847 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687d2cf0-1610-4599-bb85-35b6fe42ed50 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:29.277847 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687d2cf0-1610-4599-bb85-35b6fe42ed50 None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:29.281175 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79f668b-11f7-46e6-9d51-33a7ac280014 None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:29.330040 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b79a17b-2b2a-4f0d-b4ae-3bdc908d39e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:29.331279 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b79a17b-2b2a-4f0d-b4ae-3bdc908d39e3 None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:29.331769 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b79a17b-2b2a-4f0d-b4ae-3bdc908d39e3 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:29.332793 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b79a17b-2b2a-4f0d-b4ae-3bdc908d39e3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:29.347847 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b79a17b-2b2a-4f0d-b4ae-3bdc908d39e3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:29.351186 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b79a17b-2b2a-4f0d-b4ae-3bdc908d39e3 None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:29.371875 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application [None req-0b79a17b-2b2a-4f0d-b4ae-3bdc908d39e3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:39:29.371875 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:39:29.371875 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:39:29.371875 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:39:29.371875 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:39:29.371875 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:39:29.371875 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:39:29.371875 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:39:29.371875 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:39:29.371875 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:39:29.371875 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:39:29.371875 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:39:29.371875 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 14:39:29.371875 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 14:39:29.371875 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 14:39:29.373076 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 14:39:29.373076 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:39:29.373076 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:39:29.373076 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:39:29.373076 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:39:29.373076 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:39:29.373076 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:39:29.373076 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:39:29.373076 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application with Lock( Jul 26 14:39:29.373076 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:39:29.373076 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:39:29.373076 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:39:29.373076 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:39:29.373076 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:39:29.373076 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:39:29.373076 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:39:29.373076 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:39:29.374161 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 14:39:29.374161 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 14:39:29.374161 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:39:29.374161 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Jul 26 14:39:29.382235 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 472/923] 10.222.0.93 () {56 vars in 1108 bytes} [Tue Jul 26 14:39:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:39:29.385370 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b79a17b-2b2a-4f0d-b4ae-3bdc908d39e3 None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:29.385818 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 451/923] 10.222.0.93 () {60 vars in 1144 bytes} [Tue Jul 26 14:39:29 2022] POST /identity/v3/endpoints => generated 346 bytes in 319 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 14:39:29.534475 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b79a17b-2b2a-4f0d-b4ae-3bdc908d39e3 None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:29.537587 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:29.586370 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfaef55a-8cd9-457d-88f5-6c818b6363cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:29.586957 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaef55a-8cd9-457d-88f5-6c818b6363cb None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:29.587250 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaef55a-8cd9-457d-88f5-6c818b6363cb None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:29.587533 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaef55a-8cd9-457d-88f5-6c818b6363cb None admin] PATH_INFO: `/v3/domains` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:29.588292 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfaef55a-8cd9-457d-88f5-6c818b6363cb None admin] RBAC: Adding query filter params (name=Default) {{(pid=87056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:39:29.588609 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfaef55a-8cd9-457d-88f5-6c818b6363cb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:29.590076 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfaef55a-8cd9-457d-88f5-6c818b6363cb None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:29.605778 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 473/924] 10.222.0.93 () {56 vars in 1109 bytes} [Tue Jul 26 14:39:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:39:29.612201 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687d2cf0-1610-4599-bb85-35b6fe42ed50 None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:29.682662 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:29.789787 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687d2cf0-1610-4599-bb85-35b6fe42ed50 None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:29.844222 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6ff6d6-3fcd-44f0-9685-400650a8c4e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:29.844810 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6ff6d6-3fcd-44f0-9685-400650a8c4e8 None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:29.845093 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6ff6d6-3fcd-44f0-9685-400650a8c4e8 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:29.845366 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6ff6d6-3fcd-44f0-9685-400650a8c4e8 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:29.855807 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6ff6d6-3fcd-44f0-9685-400650a8c4e8 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:29.857688 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6ff6d6-3fcd-44f0-9685-400650a8c4e8 None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:29.876041 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application [None req-ac6ff6d6-3fcd-44f0-9685-400650a8c4e8 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 26 14:39:29.876041 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:39:29.876041 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:39:29.876041 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:39:29.876041 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:39:29.876041 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:39:29.876041 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:39:29.876041 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:39:29.876041 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:39:29.876041 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:39:29.876041 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:39:29.876041 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:39:29.876041 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 14:39:29.876041 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 14:39:29.876041 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 14:39:29.876041 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 14:39:29.877101 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:39:29.877101 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:39:29.877101 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 14:39:29.877101 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 14:39:29.877101 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 14:39:29.877101 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 14:39:29.877101 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:39:29.877101 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:39:29.877101 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:39:29.877101 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:39:29.877101 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:39:29.877101 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application with Lock( Jul 26 14:39:29.877101 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:39:29.877101 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:39:29.877101 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:39:29.877101 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:39:29.877101 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:39:29.877101 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:39:29.878225 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:39:29.878225 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:39:29.878225 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 14:39:29.878225 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 14:39:29.878225 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 14:39:29.878225 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 14:39:29.878225 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 14:39:29.878225 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 14:39:29.878225 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 26 14:39:29.878225 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Jul 26 14:39:29.878225 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 452/925] 10.222.0.93 () {56 vars in 1117 bytes} [Tue Jul 26 14:39:29 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:39:29.885407 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfaef55a-8cd9-457d-88f5-6c818b6363cb None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:30.020046 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfaef55a-8cd9-457d-88f5-6c818b6363cb None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:30.061919 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1d3bac-99f5-4fd0-853f-58f7642d2baf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:30.062608 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1d3bac-99f5-4fd0-853f-58f7642d2baf None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:30.062890 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1d3bac-99f5-4fd0-853f-58f7642d2baf None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:30.063184 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1d3bac-99f5-4fd0-853f-58f7642d2baf None admin] PATH_INFO: `/v3/users` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:30.064000 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1d3bac-99f5-4fd0-853f-58f7642d2baf None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=87056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:39:30.064320 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1d3bac-99f5-4fd0-853f-58f7642d2baf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:30.066091 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1d3bac-99f5-4fd0-853f-58f7642d2baf None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:30.088122 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 474/926] 10.222.0.93 () {56 vars in 1149 bytes} [Tue Jul 26 14:39:29 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:39:30.094041 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6ff6d6-3fcd-44f0-9685-400650a8c4e8 None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:30.241325 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:30.246935 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6ff6d6-3fcd-44f0-9685-400650a8c4e8 None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:30.273773 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f6f60d-4ff0-43b2-bd8d-4d5b7669e485 None None] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:30.274108 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f6f60d-4ff0-43b2-bd8d-4d5b7669e485 None None] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:30.274439 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f6f60d-4ff0-43b2-bd8d-4d5b7669e485 None None] PATH_INFO: `/` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:30.276175 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 475/927] 10.222.0.93 () {54 vars in 926 bytes} [Tue Jul 26 14:39:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:39:30.282404 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ad59b3-559c-4083-b79b-59578df7f2be None None] REQUEST_METHOD: `POST` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:30.282717 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ad59b3-559c-4083-b79b-59578df7f2be None None] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:30.283355 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ad59b3-559c-4083-b79b-59578df7f2be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:30.306356 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c131bb8c-cdf1-41f3-87d3-bc1ef5f13141 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:30.307057 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c131bb8c-cdf1-41f3-87d3-bc1ef5f13141 None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:30.307348 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c131bb8c-cdf1-41f3-87d3-bc1ef5f13141 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:30.307625 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c131bb8c-cdf1-41f3-87d3-bc1ef5f13141 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:30.312900 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.auth.core [None req-a2ad59b3-559c-4083-b79b-59578df7f2be None None] MFA Rules not processed for user `e5ef88cc058f425b882bcb87a1e1e75c`. Rule list: `[]` (Enabled: `True`). {{(pid=87056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:39:30.314562 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.fernet_utils [None req-a2ad59b3-559c-4083-b79b-59578df7f2be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:39:30.322643 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c131bb8c-cdf1-41f3-87d3-bc1ef5f13141 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:30.324151 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c131bb8c-cdf1-41f3-87d3-bc1ef5f13141 None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:30.336633 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:30.346701 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application [None req-c131bb8c-cdf1-41f3-87d3-bc1ef5f13141 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:39:30.346701 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:39:30.346701 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:39:30.346701 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:39:30.346701 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:39:30.346701 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:39:30.346701 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:39:30.346701 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:39:30.346701 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:39:30.346701 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:39:30.346701 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:39:30.346701 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:39:30.346701 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 14:39:30.346701 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 14:39:30.346701 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 14:39:30.347825 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 14:39:30.347825 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:39:30.347825 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:39:30.347825 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:39:30.347825 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:39:30.347825 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:39:30.347825 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:39:30.347825 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:39:30.347825 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application with Lock( Jul 26 14:39:30.347825 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:39:30.347825 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:39:30.347825 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:39:30.347825 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:39:30.347825 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:39:30.347825 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:39:30.347825 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:39:30.347825 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:39:30.349105 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 14:39:30.349105 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 14:39:30.349105 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:39:30.349105 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Jul 26 14:39:30.352408 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 453/928] 10.222.0.93 () {56 vars in 1108 bytes} [Tue Jul 26 14:39:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:39:30.353416 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c131bb8c-cdf1-41f3-87d3-bc1ef5f13141 None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:30.449507 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 476/929] 10.222.0.93 () {58 vars in 1023 bytes} [Tue Jul 26 14:39:30 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 26 14:39:30.490945 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ad59b3-559c-4083-b79b-59578df7f2be None None] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:30.543284 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c131bb8c-cdf1-41f3-87d3-bc1ef5f13141 None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:30.622272 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d241d0c1-780e-4e3a-8cd7-7c6435d3a136 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:30.623427 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d241d0c1-780e-4e3a-8cd7-7c6435d3a136 None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:30.623952 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d241d0c1-780e-4e3a-8cd7-7c6435d3a136 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:30.624424 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d241d0c1-780e-4e3a-8cd7-7c6435d3a136 None admin] PATH_INFO: `/v3/domains` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:30.626063 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d241d0c1-780e-4e3a-8cd7-7c6435d3a136 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:39:30.626640 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d241d0c1-780e-4e3a-8cd7-7c6435d3a136 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:30.629505 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d241d0c1-780e-4e3a-8cd7-7c6435d3a136 None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:30.644085 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ad59b3-559c-4083-b79b-59578df7f2be None None] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:30.657190 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 454/930] 10.222.0.93 () {56 vars in 1109 bytes} [Tue Jul 26 14:39:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:39:30.666316 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d241d0c1-780e-4e3a-8cd7-7c6435d3a136 None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:30.702285 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72788f19-f281-4aea-97ff-49326cd5024a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:30.702285 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72788f19-f281-4aea-97ff-49326cd5024a None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:30.702285 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72788f19-f281-4aea-97ff-49326cd5024a None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:30.702285 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72788f19-f281-4aea-97ff-49326cd5024a None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:30.702781 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72788f19-f281-4aea-97ff-49326cd5024a None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:30.702781 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72788f19-f281-4aea-97ff-49326cd5024a None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:30.702941 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:30.708927 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application [None req-72788f19-f281-4aea-97ff-49326cd5024a None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 26 14:39:30.708927 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:39:30.708927 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 14:39:30.708927 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 14:39:30.708927 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 14:39:30.708927 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 14:39:30.708927 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 14:39:30.708927 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 14:39:30.708927 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 26 14:39:30.708927 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Jul 26 14:39:30.708927 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 14:39:30.708927 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Jul 26 14:39:30.708927 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:39:30.708927 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:39:30.708927 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:39:30.708927 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:39:30.714744 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:39:30.714744 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:39:30.714744 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:39:30.714744 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:39:30.714744 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:39:30.714744 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:39:30.714744 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:39:30.714744 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 14:39:30.714744 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 14:39:30.714744 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 14:39:30.714744 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 14:39:30.714744 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:39:30.714744 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:39:30.714744 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:39:30.714744 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:39:30.714744 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:39:30.715584 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:39:30.715584 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:39:30.715584 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application with Lock( Jul 26 14:39:30.715584 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:39:30.715584 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:39:30.715584 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:39:30.715584 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:39:30.715584 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:39:30.715584 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:39:30.715584 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:39:30.715584 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:39:30.715584 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 14:39:30.715584 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 14:39:30.715584 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 26 14:39:30.715584 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Jul 26 14:39:30.716527 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 477/931] 10.222.0.93 () {56 vars in 1132 bytes} [Tue Jul 26 14:39:30 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 14:39:30.722273 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72788f19-f281-4aea-97ff-49326cd5024a None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:30.731979 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:30.837471 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72788f19-f281-4aea-97ff-49326cd5024a None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:30.877735 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97d1b2f-2af0-4a0b-aef5-d358fe0a8c7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:30.878518 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97d1b2f-2af0-4a0b-aef5-d358fe0a8c7f None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:30.878876 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97d1b2f-2af0-4a0b-aef5-d358fe0a8c7f None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:30.879847 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97d1b2f-2af0-4a0b-aef5-d358fe0a8c7f None admin] PATH_INFO: `/v3/services` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:30.880820 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97d1b2f-2af0-4a0b-aef5-d358fe0a8c7f None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=87056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:39:30.881209 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97d1b2f-2af0-4a0b-aef5-d358fe0a8c7f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:30.882797 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97d1b2f-2af0-4a0b-aef5-d358fe0a8c7f None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:30.889955 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d241d0c1-780e-4e3a-8cd7-7c6435d3a136 None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:30.893365 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 478/932] 10.222.0.93 () {56 vars in 1126 bytes} [Tue Jul 26 14:39:30 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:39:30.894457 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97d1b2f-2af0-4a0b-aef5-d358fe0a8c7f None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:30.963106 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bdf39a-bf69-47cf-834a-edd25617cfa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:30.964071 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bdf39a-bf69-47cf-834a-edd25617cfa1 None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:30.964528 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bdf39a-bf69-47cf-834a-edd25617cfa1 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:30.965569 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bdf39a-bf69-47cf-834a-edd25617cfa1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:30.976665 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bdf39a-bf69-47cf-834a-edd25617cfa1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:30.979037 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bdf39a-bf69-47cf-834a-edd25617cfa1 None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:31.010874 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application [None req-09bdf39a-bf69-47cf-834a-edd25617cfa1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 14:39:31.010874 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:39:31.010874 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:39:31.010874 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:39:31.010874 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:39:31.010874 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:39:31.010874 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:39:31.010874 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:39:31.010874 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:39:31.010874 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:39:31.010874 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:39:31.010874 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:39:31.010874 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 14:39:31.010874 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 14:39:31.010874 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 14:39:31.012541 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 14:39:31.012541 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:39:31.012541 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:39:31.012541 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:39:31.012541 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:39:31.012541 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:39:31.012541 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:39:31.012541 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:39:31.012541 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application with Lock( Jul 26 14:39:31.012541 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:39:31.012541 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:39:31.012541 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:39:31.012541 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:39:31.012541 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:39:31.012541 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:39:31.012541 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:39:31.012541 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:39:31.014352 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 14:39:31.014352 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 14:39:31.014352 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 14:39:31.014352 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 14:39:31.014352 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 14:39:31.014352 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 14:39:31.014352 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 14:39:31.014352 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Jul 26 14:39:31.021178 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 455/933] 10.222.0.93 () {56 vars in 1111 bytes} [Tue Jul 26 14:39:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 356 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:39:31.027910 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bdf39a-bf69-47cf-834a-edd25617cfa1 None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:31.035303 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:31.073141 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97d1b2f-2af0-4a0b-aef5-d358fe0a8c7f None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:31.121875 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfccdb4-b528-4bdb-a822-b34598d26b55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:31.122165 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfccdb4-b528-4bdb-a822-b34598d26b55 None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:31.122527 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfccdb4-b528-4bdb-a822-b34598d26b55 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:31.122670 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfccdb4-b528-4bdb-a822-b34598d26b55 None admin] PATH_INFO: `/v3/services` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:31.123507 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfccdb4-b528-4bdb-a822-b34598d26b55 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=87056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:39:31.123830 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfccdb4-b528-4bdb-a822-b34598d26b55 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:31.125466 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfccdb4-b528-4bdb-a822-b34598d26b55 None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:31.137535 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 479/934] 10.222.0.93 () {56 vars in 1126 bytes} [Tue Jul 26 14:39:30 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:39:31.139192 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd103df-c3a5-4b84-b6e5-d6eee19f47ff None None] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:31.139488 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd103df-c3a5-4b84-b6e5-d6eee19f47ff None None] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:31.139839 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd103df-c3a5-4b84-b6e5-d6eee19f47ff None None] PATH_INFO: `/` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:31.141494 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 480/935] 10.222.0.93 () {54 vars in 926 bytes} [Tue Jul 26 14:39:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:39:31.142619 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd103df-c3a5-4b84-b6e5-d6eee19f47ff None None] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:31.189475 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:31.240697 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bdf39a-bf69-47cf-834a-edd25617cfa1 None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:31.280655 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd103df-c3a5-4b84-b6e5-d6eee19f47ff None None] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:31.309076 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a4ce90-79f9-4fb2-a4b5-1024a56d5208 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:31.310185 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a4ce90-79f9-4fb2-a4b5-1024a56d5208 None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:31.310751 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a4ce90-79f9-4fb2-a4b5-1024a56d5208 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:31.311267 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a4ce90-79f9-4fb2-a4b5-1024a56d5208 None admin] PATH_INFO: `/v3/projects` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:31.312606 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a4ce90-79f9-4fb2-a4b5-1024a56d5208 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:39:31.313245 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a4ce90-79f9-4fb2-a4b5-1024a56d5208 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:31.316133 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a4ce90-79f9-4fb2-a4b5-1024a56d5208 None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:31.326120 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce9b6dd-bbb8-4d32-8e39-ceeae0a1cf10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:31.327642 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce9b6dd-bbb8-4d32-8e39-ceeae0a1cf10 None admin] REQUEST_METHOD: `POST` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:31.327989 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce9b6dd-bbb8-4d32-8e39-ceeae0a1cf10 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:31.328232 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce9b6dd-bbb8-4d32-8e39-ceeae0a1cf10 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:31.329458 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce9b6dd-bbb8-4d32-8e39-ceeae0a1cf10 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:31.331057 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce9b6dd-bbb8-4d32-8e39-ceeae0a1cf10 None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:31.333351 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 456/936] 10.222.0.93 () {56 vars in 1148 bytes} [Tue Jul 26 14:39:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:39:31.339645 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cc3cd7-508a-4b4f-b6ef-efac3543814b None None] REQUEST_METHOD: `POST` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:31.339939 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cc3cd7-508a-4b4f-b6ef-efac3543814b None None] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:31.340310 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cc3cd7-508a-4b4f-b6ef-efac3543814b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:31.346518 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:31.362164 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.auth.core [None req-16cc3cd7-508a-4b4f-b6ef-efac3543814b None None] MFA Rules not processed for user `e5ef88cc058f425b882bcb87a1e1e75c`. Rule list: `[]` (Enabled: `True`). {{(pid=87055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:39:31.363646 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.fernet_utils [None req-16cc3cd7-508a-4b4f-b6ef-efac3543814b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:39:31.447945 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 457/937] 10.222.0.93 () {58 vars in 1023 bytes} [Tue Jul 26 14:39:31 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 14:39:31.448754 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cc3cd7-508a-4b4f-b6ef-efac3543814b None None] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:31.483064 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 481/938] 10.222.0.93 () {60 vars in 1144 bytes} [Tue Jul 26 14:39:31 2022] POST /identity/v3/endpoints => generated 347 bytes in 341 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 14:39:31.487855 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce9b6dd-bbb8-4d32-8e39-ceeae0a1cf10 None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:31.570581 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:31.662670 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cc3cd7-508a-4b4f-b6ef-efac3543814b None None] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:31.685062 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce9b6dd-bbb8-4d32-8e39-ceeae0a1cf10 None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:31.722655 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febc073a-36f2-48b0-a80c-07eb3b2f8ebf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:31.723884 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febc073a-36f2-48b0-a80c-07eb3b2f8ebf None admin] REQUEST_METHOD: `PUT` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:31.724947 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febc073a-36f2-48b0-a80c-07eb3b2f8ebf None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:31.724947 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febc073a-36f2-48b0-a80c-07eb3b2f8ebf None admin] PATH_INFO: `/v3/projects/c422a2290a14424da20e2841cbc1741d/users/0205dfcfb5e5404c95aefc1f45a1e1e6/roles/fb41e639164e46ba82e91c6a63dd4898` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:31.728414 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febc073a-36f2-48b0-a80c-07eb3b2f8ebf None admin] RBAC: Authorizing `identity:create_grant(project_id=c422a2290a14424da20e2841cbc1741d, user_id=0205dfcfb5e5404c95aefc1f45a1e1e6, role_id=fb41e639164e46ba82e91c6a63dd4898)` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:31.729483 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febc073a-36f2-48b0-a80c-07eb3b2f8ebf None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:31.751363 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59fa940-2277-4c06-82bf-2791ad166ce6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:31.753239 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59fa940-2277-4c06-82bf-2791ad166ce6 None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:31.753755 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59fa940-2277-4c06-82bf-2791ad166ce6 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:31.754147 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59fa940-2277-4c06-82bf-2791ad166ce6 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:31.755465 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59fa940-2277-4c06-82bf-2791ad166ce6 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:31.757977 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59fa940-2277-4c06-82bf-2791ad166ce6 None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:31.771560 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application [None req-d59fa940-2277-4c06-82bf-2791ad166ce6 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 26 14:39:31.771560 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:39:31.771560 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 14:39:31.771560 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 14:39:31.771560 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 14:39:31.771560 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 14:39:31.771560 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 14:39:31.771560 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 14:39:31.771560 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 26 14:39:31.771560 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Jul 26 14:39:31.771560 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 14:39:31.771560 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Jul 26 14:39:31.771560 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:39:31.771560 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:39:31.771560 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:39:31.771560 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:39:31.771560 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:39:31.772725 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:39:31.772725 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:39:31.772725 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:39:31.772725 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:39:31.772725 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:39:31.772725 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:39:31.772725 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 14:39:31.772725 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 14:39:31.772725 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 14:39:31.772725 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 14:39:31.772725 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:39:31.772725 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:39:31.772725 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:39:31.772725 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:39:31.772725 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:39:31.772725 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:39:31.773575 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:39:31.773575 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application with Lock( Jul 26 14:39:31.773575 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:39:31.773575 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:39:31.773575 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:39:31.773575 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:39:31.773575 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:39:31.773575 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:39:31.773575 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:39:31.773575 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:39:31.773575 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 14:39:31.773575 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 14:39:31.773575 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 26 14:39:31.773575 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Jul 26 14:39:31.773575 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 482/939] 10.222.0.93 () {56 vars in 1126 bytes} [Tue Jul 26 14:39:31 2022] GET /identity/v3/services/object-store => generated 93 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:39:31.780988 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59fa940-2277-4c06-82bf-2791ad166ce6 None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:31.851668 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 458/940] 10.222.0.93 () {58 vars in 1439 bytes} [Tue Jul 26 14:39:31 2022] PUT /identity/v3/projects/c422a2290a14424da20e2841cbc1741d/users/0205dfcfb5e5404c95aefc1f45a1e1e6/roles/fb41e639164e46ba82e91c6a63dd4898 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 14:39:31.877712 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:31.937673 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59fa940-2277-4c06-82bf-2791ad166ce6 None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:31.982160 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68b5f5f-9660-483e-8a6b-b0074e911417 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:31.982799 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68b5f5f-9660-483e-8a6b-b0074e911417 None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:31.983099 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68b5f5f-9660-483e-8a6b-b0074e911417 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:31.983362 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68b5f5f-9660-483e-8a6b-b0074e911417 None admin] PATH_INFO: `/v3/services` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:31.984070 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68b5f5f-9660-483e-8a6b-b0074e911417 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=87056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:39:31.984381 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68b5f5f-9660-483e-8a6b-b0074e911417 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:31.987201 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68b5f5f-9660-483e-8a6b-b0074e911417 None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:31.994865 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 483/941] 10.222.0.93 () {56 vars in 1122 bytes} [Tue Jul 26 14:39:31 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:39:32.004796 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febc073a-36f2-48b0-a80c-07eb3b2f8ebf None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:32.156131 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febc073a-36f2-48b0-a80c-07eb3b2f8ebf None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:32.193434 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:32.215851 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35256a0b-3364-4c29-a72f-256ba4b40a96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:32.216906 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35256a0b-3364-4c29-a72f-256ba4b40a96 None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:32.217396 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35256a0b-3364-4c29-a72f-256ba4b40a96 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:32.217915 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35256a0b-3364-4c29-a72f-256ba4b40a96 None admin] PATH_INFO: `/v3/services` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:32.219224 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35256a0b-3364-4c29-a72f-256ba4b40a96 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=87055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:39:32.219806 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35256a0b-3364-4c29-a72f-256ba4b40a96 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:32.222559 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35256a0b-3364-4c29-a72f-256ba4b40a96 None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:32.233333 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 459/942] 10.222.0.93 () {56 vars in 1122 bytes} [Tue Jul 26 14:39:31 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:39:32.240679 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68b5f5f-9660-483e-8a6b-b0074e911417 None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:32.378743 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68b5f5f-9660-483e-8a6b-b0074e911417 None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:32.407108 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:32.422081 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b5005d-c7c5-421e-92bc-4d6f443c05f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:32.422822 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b5005d-c7c5-421e-92bc-4d6f443c05f4 None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:32.423114 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b5005d-c7c5-421e-92bc-4d6f443c05f4 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:32.423490 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b5005d-c7c5-421e-92bc-4d6f443c05f4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:32.424304 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b5005d-c7c5-421e-92bc-4d6f443c05f4 None admin] RBAC: Adding query filter params (interface=public, service_id=9313a0c835864357b53e5a10dbb5fd45, region_id=RegionOne) {{(pid=87056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:39:32.424624 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b5005d-c7c5-421e-92bc-4d6f443c05f4 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:32.426592 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b5005d-c7c5-421e-92bc-4d6f443c05f4 None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:32.433117 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 484/943] 10.222.0.93 () {56 vars in 1251 bytes} [Tue Jul 26 14:39:32 2022] GET /identity/v3/endpoints?service_id=9313a0c835864357b53e5a10dbb5fd45&interface=public®ion_id=RegionOne => generated 194 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:39:32.438990 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35256a0b-3364-4c29-a72f-256ba4b40a96 None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:32.619565 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35256a0b-3364-4c29-a72f-256ba4b40a96 None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:32.637168 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b89cae0-ef48-4cc6-b567-6ec9fa729151 None None] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:32.637639 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b89cae0-ef48-4cc6-b567-6ec9fa729151 None None] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:32.638116 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b89cae0-ef48-4cc6-b567-6ec9fa729151 None None] PATH_INFO: `/` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:32.646873 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 485/944] 10.222.0.93 () {54 vars in 926 bytes} [Tue Jul 26 14:39:32 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:39:32.651243 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f3db47-1694-407a-9329-a72ef496171e None None] REQUEST_METHOD: `POST` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:32.651755 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f3db47-1694-407a-9329-a72ef496171e None None] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:32.652247 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f3db47-1694-407a-9329-a72ef496171e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:32.684748 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.auth.core [None req-71f3db47-1694-407a-9329-a72ef496171e None None] MFA Rules not processed for user `e5ef88cc058f425b882bcb87a1e1e75c`. Rule list: `[]` (Enabled: `True`). {{(pid=87056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:39:32.686926 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.fernet_utils [None req-71f3db47-1694-407a-9329-a72ef496171e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:39:32.705778 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a31fef3-71d4-4680-81bd-b482b9a1d3af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:32.707109 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a31fef3-71d4-4680-81bd-b482b9a1d3af None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:32.707604 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a31fef3-71d4-4680-81bd-b482b9a1d3af None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:32.708101 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a31fef3-71d4-4680-81bd-b482b9a1d3af None admin] PATH_INFO: `/v3/services` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:32.709463 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a31fef3-71d4-4680-81bd-b482b9a1d3af None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:32.712103 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a31fef3-71d4-4680-81bd-b482b9a1d3af None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:32.726307 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 460/945] 10.222.0.93 () {56 vars in 1087 bytes} [Tue Jul 26 14:39:32 2022] GET /identity/v3/services => generated 1497 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 14:39:32.834500 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 486/946] 10.222.0.93 () {58 vars in 1023 bytes} [Tue Jul 26 14:39:32 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 26 14:39:32.871437 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a31fef3-71d4-4680-81bd-b482b9a1d3af None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:32.982137 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:33.090694 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a31fef3-71d4-4680-81bd-b482b9a1d3af None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:33.167345 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4617a598-9fa8-4a09-a08e-1635dd0dba0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:33.168359 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4617a598-9fa8-4a09-a08e-1635dd0dba0d None admin] REQUEST_METHOD: `POST` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:33.168867 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4617a598-9fa8-4a09-a08e-1635dd0dba0d None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:33.169375 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4617a598-9fa8-4a09-a08e-1635dd0dba0d None admin] PATH_INFO: `/v3/projects` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:33.170727 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4617a598-9fa8-4a09-a08e-1635dd0dba0d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:33.173557 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4617a598-9fa8-4a09-a08e-1635dd0dba0d None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:33.178855 dv-cinder-851030-1-smb devstack@keystone.service[87055]: WARNING keystone.server.flask.common [None req-4617a598-9fa8-4a09-a08e-1635dd0dba0d None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 26 14:39:33.254662 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.sql.core [None req-4617a598-9fa8-4a09-a08e-1635dd0dba0d None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 26 14:39:33.254662 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 26 14:39:33.254662 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [parameters: {'id': 'bdf1f29f535145a891f2f05c0a758ce3', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 26 14:39:33.254662 dv-cinder-851030-1-smb devstack@keystone.service[87055]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=87055) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 26 14:39:33.287765 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application [None req-4617a598-9fa8-4a09-a08e-1635dd0dba0d None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id bdf1f29f535145a891f2f05c0a758ce3.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id bdf1f29f535145a891f2f05c0a758ce3. Jul 26 14:39:33.287765 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:39:33.287765 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 26 14:39:33.287765 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 26 14:39:33.287765 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 26 14:39:33.287765 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 26 14:39:33.287765 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 26 14:39:33.287765 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application result = self._query(query) Jul 26 14:39:33.287765 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 26 14:39:33.287765 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application conn.query(q) Jul 26 14:39:33.287765 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 26 14:39:33.287765 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 26 14:39:33.287765 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 26 14:39:33.288790 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application result.read() Jul 26 14:39:33.288790 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 26 14:39:33.288790 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 26 14:39:33.288790 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 26 14:39:33.288790 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 26 14:39:33.288790 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 26 14:39:33.288790 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 26 14:39:33.288790 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 26 14:39:33.288790 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 26 14:39:33.288790 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 26 14:39:33.288790 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Jul 26 14:39:33.288790 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 26 14:39:33.288790 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Jul 26 14:39:33.288790 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:39:33.288790 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 26 14:39:33.288790 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 26 14:39:33.288790 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jul 26 14:39:33.288790 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return project_ref.to_dict() Jul 26 14:39:33.289752 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 26 14:39:33.289752 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application next(self.gen) Jul 26 14:39:33.289752 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 26 14:39:33.289752 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application yield resource Jul 26 14:39:33.289752 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 26 14:39:33.289752 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application next(self.gen) Jul 26 14:39:33.289752 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 26 14:39:33.289752 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application self.session.rollback() Jul 26 14:39:33.289752 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 26 14:39:33.289752 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application self.force_reraise() Jul 26 14:39:33.289752 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 26 14:39:33.289752 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application raise self.value Jul 26 14:39:33.289752 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 26 14:39:33.289752 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 26 14:39:33.289752 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 26 14:39:33.289752 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application session.commit() Jul 26 14:39:33.289752 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 26 14:39:33.290780 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 26 14:39:33.290780 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 26 14:39:33.290780 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application self._prepare_impl() Jul 26 14:39:33.290780 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 26 14:39:33.290780 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application self.session.flush() Jul 26 14:39:33.290780 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 26 14:39:33.290780 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application self._flush(objects) Jul 26 14:39:33.290780 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 26 14:39:33.290780 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 26 14:39:33.290780 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 26 14:39:33.290780 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application compat.raise_( Jul 26 14:39:33.290780 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 26 14:39:33.290780 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application raise exception Jul 26 14:39:33.290780 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 26 14:39:33.290780 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application flush_context.execute() Jul 26 14:39:33.290780 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 26 14:39:33.290780 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application rec.execute(self) Jul 26 14:39:33.291853 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 26 14:39:33.291853 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 26 14:39:33.291853 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 26 14:39:33.291853 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 26 14:39:33.291853 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 26 14:39:33.291853 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 26 14:39:33.291853 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 26 14:39:33.291853 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 26 14:39:33.291853 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 26 14:39:33.291853 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 26 14:39:33.291853 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 26 14:39:33.291853 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 26 14:39:33.291853 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 26 14:39:33.291853 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 26 14:39:33.291853 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 26 14:39:33.292697 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 26 14:39:33.292697 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 26 14:39:33.292697 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application raise exception Jul 26 14:39:33.292697 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 26 14:39:33.292697 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 26 14:39:33.292697 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 26 14:39:33.292697 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 26 14:39:33.292697 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 26 14:39:33.292697 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application result = self._query(query) Jul 26 14:39:33.292697 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 26 14:39:33.292697 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application conn.query(q) Jul 26 14:39:33.292697 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 26 14:39:33.292697 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 26 14:39:33.292697 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 26 14:39:33.292697 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application result.read() Jul 26 14:39:33.292697 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 26 14:39:33.292697 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 26 14:39:33.293592 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 26 14:39:33.293592 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 26 14:39:33.293592 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 26 14:39:33.293592 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 26 14:39:33.293592 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 26 14:39:33.293592 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 26 14:39:33.293592 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 26 14:39:33.293592 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 26 14:39:33.293592 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application [parameters: {'id': 'bdf1f29f535145a891f2f05c0a758ce3', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 26 14:39:33.293592 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 26 14:39:33.293592 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Jul 26 14:39:33.293592 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 14:39:33.293592 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Jul 26 14:39:33.293592 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:39:33.293592 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jul 26 14:39:33.295792 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jul 26 14:39:33.295792 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 26 14:39:33.295792 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 26 14:39:33.295792 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jul 26 14:39:33.295792 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Jul 26 14:39:33.295792 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 14:39:33.295792 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Jul 26 14:39:33.295792 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:39:33.295792 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:39:33.295792 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:39:33.295792 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:39:33.295792 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:39:33.295792 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:39:33.295792 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:39:33.295792 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:39:33.295792 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:39:33.295792 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:39:33.298151 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:39:33.298151 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jul 26 14:39:33.298151 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jul 26 14:39:33.298151 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:39:33.298151 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:39:33.298151 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jul 26 14:39:33.298151 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application raise exception.Conflict( Jul 26 14:39:33.298151 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id bdf1f29f535145a891f2f05c0a758ce3. Jul 26 14:39:33.298151 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Jul 26 14:39:33.298151 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 461/947] 10.222.0.93 () {60 vars in 1140 bytes} [Tue Jul 26 14:39:32 2022] POST /identity/v3/projects => generated 262 bytes in 420 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:39:33.303843 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f3db47-1694-407a-9329-a72ef496171e None None] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:33.498012 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f3db47-1694-407a-9329-a72ef496171e None None] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:33.530909 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:33.552423 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be017f9-b702-433f-aed2-2b96b4483e5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:33.553103 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be017f9-b702-433f-aed2-2b96b4483e5a None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:33.553384 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be017f9-b702-433f-aed2-2b96b4483e5a None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:33.553661 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be017f9-b702-433f-aed2-2b96b4483e5a None admin] PATH_INFO: `/v3/projects/service` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:33.561652 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be017f9-b702-433f-aed2-2b96b4483e5a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:33.563165 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be017f9-b702-433f-aed2-2b96b4483e5a None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:33.577154 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application [None req-3be017f9-b702-433f-aed2-2b96b4483e5a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 14:39:33.577154 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:39:33.577154 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:39:33.577154 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:39:33.577154 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:39:33.577154 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:39:33.577154 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:39:33.577154 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:39:33.577154 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:39:33.577154 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:39:33.577154 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:39:33.577154 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:39:33.577154 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 14:39:33.577154 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 14:39:33.577154 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 14:39:33.579166 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 14:39:33.579166 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:39:33.579166 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:39:33.579166 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:39:33.579166 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:39:33.579166 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:39:33.579166 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:39:33.579166 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:39:33.579166 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application with Lock( Jul 26 14:39:33.579166 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:39:33.579166 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:39:33.579166 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:39:33.579166 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:39:33.579166 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:39:33.579166 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:39:33.579166 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:39:33.579166 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:39:33.580966 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 14:39:33.580966 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 14:39:33.580966 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 14:39:33.580966 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 14:39:33.580966 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 14:39:33.580966 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 14:39:33.580966 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 14:39:33.580966 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Jul 26 14:39:33.586290 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 487/948] 10.222.0.93 () {56 vars in 1111 bytes} [Tue Jul 26 14:39:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:39:33.595131 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4617a598-9fa8-4a09-a08e-1635dd0dba0d None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:33.817204 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4617a598-9fa8-4a09-a08e-1635dd0dba0d None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:33.833868 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:33.868468 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f3b6a9-9055-4416-8086-1869de5bd1ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:33.869201 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f3b6a9-9055-4416-8086-1869de5bd1ed None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:33.869491 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f3b6a9-9055-4416-8086-1869de5bd1ed None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:33.869775 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f3b6a9-9055-4416-8086-1869de5bd1ed None admin] PATH_INFO: `/v3/projects` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:33.870577 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f3b6a9-9055-4416-8086-1869de5bd1ed None admin] RBAC: Adding query filter params (name=service) {{(pid=87055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:39:33.870889 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f3b6a9-9055-4416-8086-1869de5bd1ed None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:33.872748 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f3b6a9-9055-4416-8086-1869de5bd1ed None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:33.898455 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 462/949] 10.222.0.93 () {56 vars in 1112 bytes} [Tue Jul 26 14:39:33 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:39:34.506018 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5518e8d-58c5-44f7-8082-1bdc6258c888 None None] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:34.506622 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5518e8d-58c5-44f7-8082-1bdc6258c888 None None] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:34.507168 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5518e8d-58c5-44f7-8082-1bdc6258c888 None None] PATH_INFO: `/` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:34.510296 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 488/950] 10.222.0.93 () {54 vars in 926 bytes} [Tue Jul 26 14:39:34 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:39:34.516291 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cdd6cd-b0e4-45b7-83e8-be337374f53d None None] REQUEST_METHOD: `POST` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:34.516700 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cdd6cd-b0e4-45b7-83e8-be337374f53d None None] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:34.516992 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cdd6cd-b0e4-45b7-83e8-be337374f53d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:34.539620 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.auth.core [None req-06cdd6cd-b0e4-45b7-83e8-be337374f53d None None] MFA Rules not processed for user `e5ef88cc058f425b882bcb87a1e1e75c`. Rule list: `[]` (Enabled: `True`). {{(pid=87055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:39:34.541254 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.fernet_utils [None req-06cdd6cd-b0e4-45b7-83e8-be337374f53d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:39:34.627182 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 463/951] 10.222.0.93 () {58 vars in 1023 bytes} [Tue Jul 26 14:39:34 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 26 14:39:34.654451 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5518e8d-58c5-44f7-8082-1bdc6258c888 None None] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:34.777631 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5518e8d-58c5-44f7-8082-1bdc6258c888 None None] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:34.819729 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca27d778-89cb-4367-87da-37ed0c494988 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:34.820403 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca27d778-89cb-4367-87da-37ed0c494988 None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:34.820690 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca27d778-89cb-4367-87da-37ed0c494988 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:34.820988 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca27d778-89cb-4367-87da-37ed0c494988 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:34.835192 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca27d778-89cb-4367-87da-37ed0c494988 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 14:39:34.840355 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90085608-8184-4fe1-8bbf-467ffb5638db None None] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:34.840600 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application [None req-ca27d778-89cb-4367-87da-37ed0c494988 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 26 14:39:34.840600 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:39:34.840600 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:39:34.840600 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:39:34.840600 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:39:34.840600 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:39:34.840600 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:39:34.840600 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:39:34.840600 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:39:34.840600 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:39:34.840600 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:39:34.840600 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:39:34.840600 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 14:39:34.840600 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 14:39:34.840600 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 14:39:34.840600 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 14:39:34.842441 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 14:39:34.842441 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 14:39:34.842441 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 14:39:34.842441 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 14:39:34.842441 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:39:34.842441 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:39:34.842441 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:39:34.842441 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:39:34.842441 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:39:34.842441 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:39:34.842441 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:39:34.842441 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application with Lock( Jul 26 14:39:34.842441 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:39:34.842441 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:39:34.842441 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:39:34.842441 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:39:34.844185 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:39:34.844185 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:39:34.844185 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:39:34.844185 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:39:34.844185 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 14:39:34.844185 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 14:39:34.844185 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 14:39:34.844185 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 14:39:34.844185 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 14:39:34.844185 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 14:39:34.844185 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 26 14:39:34.844185 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Jul 26 14:39:34.844185 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 489/952] 10.222.0.93 () {56 vars in 1120 bytes} [Tue Jul 26 14:39:34 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:39:34.847452 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90085608-8184-4fe1-8bbf-467ffb5638db None None] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:34.848584 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca27d778-89cb-4367-87da-37ed0c494988 None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:34.849495 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90085608-8184-4fe1-8bbf-467ffb5638db None None] PATH_INFO: `/` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:34.858456 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 464/953] 10.222.0.93 () {54 vars in 926 bytes} [Tue Jul 26 14:39:34 2022] GET /identity => generated 270 bytes in 20 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 14:39:34.863248 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b86f789-444e-4b8d-acdc-3b58fe66102c None None] REQUEST_METHOD: `POST` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:34.864180 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b86f789-444e-4b8d-acdc-3b58fe66102c None None] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:34.864952 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b86f789-444e-4b8d-acdc-3b58fe66102c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:34.897207 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:34.900015 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.auth.core [None req-1b86f789-444e-4b8d-acdc-3b58fe66102c None None] MFA Rules not processed for user `e5ef88cc058f425b882bcb87a1e1e75c`. Rule list: `[]` (Enabled: `True`). {{(pid=87055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:39:34.902219 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.fernet_utils [None req-1b86f789-444e-4b8d-acdc-3b58fe66102c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:39:34.996865 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca27d778-89cb-4367-87da-37ed0c494988 None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:35.042932 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 465/954] 10.222.0.93 () {58 vars in 1023 bytes} [Tue Jul 26 14:39:34 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 14:39:35.066218 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22962c9e-062a-4085-b333-32c2cec29dfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:35.067429 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22962c9e-062a-4085-b333-32c2cec29dfd None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:35.067932 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22962c9e-062a-4085-b333-32c2cec29dfd None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:35.068434 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22962c9e-062a-4085-b333-32c2cec29dfd None admin] PATH_INFO: `/v3/roles` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:35.069870 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22962c9e-062a-4085-b333-32c2cec29dfd None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=87056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:39:35.070529 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22962c9e-062a-4085-b333-32c2cec29dfd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:35.072741 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22962c9e-062a-4085-b333-32c2cec29dfd None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:35.076741 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b86f789-444e-4b8d-acdc-3b58fe66102c None None] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:35.084793 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 490/955] 10.222.0.93 () {56 vars in 1115 bytes} [Tue Jul 26 14:39:34 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:39:35.091071 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22962c9e-062a-4085-b333-32c2cec29dfd None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:35.114204 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:35.203582 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b86f789-444e-4b8d-acdc-3b58fe66102c None None] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:35.205573 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:35.214084 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22962c9e-062a-4085-b333-32c2cec29dfd None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:35.246946 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99acd84e-5c7e-4dde-a67d-6e6a5d69f201 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:35.247929 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99acd84e-5c7e-4dde-a67d-6e6a5d69f201 None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:35.248211 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99acd84e-5c7e-4dde-a67d-6e6a5d69f201 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:35.248479 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99acd84e-5c7e-4dde-a67d-6e6a5d69f201 None admin] PATH_INFO: `/v3/services/compute` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:35.249131 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99acd84e-5c7e-4dde-a67d-6e6a5d69f201 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:35.250569 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99acd84e-5c7e-4dde-a67d-6e6a5d69f201 None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:35.256054 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a869006-f4c4-47e2-bc9b-dd73cfea587b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:35.256705 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a869006-f4c4-47e2-bc9b-dd73cfea587b None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:35.256987 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a869006-f4c4-47e2-bc9b-dd73cfea587b None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:35.257263 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a869006-f4c4-47e2-bc9b-dd73cfea587b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:35.261819 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application [None req-99acd84e-5c7e-4dde-a67d-6e6a5d69f201 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 26 14:39:35.261819 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:39:35.261819 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 14:39:35.261819 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 14:39:35.261819 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 14:39:35.261819 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 14:39:35.261819 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 14:39:35.261819 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 14:39:35.261819 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 26 14:39:35.261819 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Jul 26 14:39:35.261819 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 14:39:35.261819 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Jul 26 14:39:35.261819 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:39:35.261819 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:39:35.261819 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:39:35.261819 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:39:35.261819 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:39:35.263251 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:39:35.263251 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:39:35.263251 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:39:35.263251 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:39:35.263251 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:39:35.263251 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:39:35.263251 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 14:39:35.263251 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 14:39:35.263251 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 14:39:35.263251 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 14:39:35.263251 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:39:35.263251 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:39:35.263251 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:39:35.263251 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:39:35.263251 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:39:35.263251 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:39:35.264197 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:39:35.264197 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application with Lock( Jul 26 14:39:35.264197 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:39:35.264197 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:39:35.264197 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:39:35.264197 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:39:35.264197 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:39:35.264197 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:39:35.264197 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:39:35.264197 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:39:35.264197 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 14:39:35.264197 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 14:39:35.264197 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 26 14:39:35.264197 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Jul 26 14:39:35.268379 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 466/956] 10.222.0.93 () {56 vars in 1111 bytes} [Tue Jul 26 14:39:35 2022] GET /identity/v3/services/compute => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 14:39:35.270439 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68787522-a4ad-4971-a5e2-1c59dfa07c56 None None] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:35.270635 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a869006-f4c4-47e2-bc9b-dd73cfea587b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:35.270751 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68787522-a4ad-4971-a5e2-1c59dfa07c56 None None] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:35.270844 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68787522-a4ad-4971-a5e2-1c59dfa07c56 None None] PATH_INFO: `/` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:35.271672 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a869006-f4c4-47e2-bc9b-dd73cfea587b None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:35.272231 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 467/957] 10.222.0.93 () {54 vars in 926 bytes} [Tue Jul 26 14:39:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:39:35.274572 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68787522-a4ad-4971-a5e2-1c59dfa07c56 None None] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:35.294983 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application [None req-9a869006-f4c4-47e2-bc9b-dd73cfea587b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:39:35.294983 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:39:35.294983 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:39:35.294983 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:39:35.294983 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:39:35.294983 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:39:35.294983 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:39:35.294983 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:39:35.294983 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:39:35.294983 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:39:35.294983 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:39:35.294983 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:39:35.294983 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 14:39:35.294983 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 14:39:35.294983 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 14:39:35.296076 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 14:39:35.296076 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:39:35.296076 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:39:35.296076 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:39:35.296076 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:39:35.296076 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:39:35.296076 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:39:35.296076 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:39:35.296076 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application with Lock( Jul 26 14:39:35.296076 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:39:35.296076 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:39:35.296076 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:39:35.296076 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:39:35.296076 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:39:35.296076 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:39:35.296076 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:39:35.296076 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:39:35.297248 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 14:39:35.297248 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 14:39:35.297248 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:39:35.297248 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Jul 26 14:39:35.297248 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 491/958] 10.222.0.93 () {56 vars in 1108 bytes} [Tue Jul 26 14:39:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:39:35.297624 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1210d6-dd65-43a9-9574-6f77492a7218 None None] REQUEST_METHOD: `POST` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:35.297747 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1210d6-dd65-43a9-9574-6f77492a7218 None None] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:35.298395 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1210d6-dd65-43a9-9574-6f77492a7218 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:35.319765 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.auth.core [None req-ba1210d6-dd65-43a9-9574-6f77492a7218 None None] MFA Rules not processed for user `e5ef88cc058f425b882bcb87a1e1e75c`. Rule list: `[]` (Enabled: `True`). {{(pid=87056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:39:35.321398 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.fernet_utils [None req-ba1210d6-dd65-43a9-9574-6f77492a7218 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:39:35.397676 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:35.415897 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 492/959] 10.222.0.93 () {58 vars in 1023 bytes} [Tue Jul 26 14:39:35 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 14:39:35.415897 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1210d6-dd65-43a9-9574-6f77492a7218 None None] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:35.431832 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68787522-a4ad-4971-a5e2-1c59dfa07c56 None None] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:35.497346 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b00d66-153b-411d-90cd-8bbaa99afaf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:35.498309 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b00d66-153b-411d-90cd-8bbaa99afaf9 None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:35.498781 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b00d66-153b-411d-90cd-8bbaa99afaf9 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:35.499251 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b00d66-153b-411d-90cd-8bbaa99afaf9 None admin] PATH_INFO: `/v3/services` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:35.500296 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b00d66-153b-411d-90cd-8bbaa99afaf9 None admin] RBAC: Adding query filter params (name=compute) {{(pid=87055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:39:35.500811 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b00d66-153b-411d-90cd-8bbaa99afaf9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:35.503474 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b00d66-153b-411d-90cd-8bbaa99afaf9 None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:35.517256 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 468/960] 10.222.0.93 () {56 vars in 1112 bytes} [Tue Jul 26 14:39:35 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:39:35.517256 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b00d66-153b-411d-90cd-8bbaa99afaf9 None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:35.538281 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:35.569006 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1210d6-dd65-43a9-9574-6f77492a7218 None None] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:35.612752 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dc804f-9e8f-4ede-8387-dab4912f3db0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:35.613436 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dc804f-9e8f-4ede-8387-dab4912f3db0 None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:35.613721 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dc804f-9e8f-4ede-8387-dab4912f3db0 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:35.613998 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dc804f-9e8f-4ede-8387-dab4912f3db0 None admin] PATH_INFO: `/v3/domains` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:35.614808 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36dc804f-9e8f-4ede-8387-dab4912f3db0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:39:35.615118 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36dc804f-9e8f-4ede-8387-dab4912f3db0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:35.616582 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36dc804f-9e8f-4ede-8387-dab4912f3db0 None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:35.630000 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 493/961] 10.222.0.93 () {56 vars in 1109 bytes} [Tue Jul 26 14:39:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:39:35.630703 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dc804f-9e8f-4ede-8387-dab4912f3db0 None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:35.657119 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b00d66-153b-411d-90cd-8bbaa99afaf9 None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:35.713662 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46167e12-caa4-4f9a-844d-f39d3eec78d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:35.714372 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46167e12-caa4-4f9a-844d-f39d3eec78d7 None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:35.714660 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46167e12-caa4-4f9a-844d-f39d3eec78d7 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:35.714944 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46167e12-caa4-4f9a-844d-f39d3eec78d7 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:35.715616 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46167e12-caa4-4f9a-844d-f39d3eec78d7 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:35.717076 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46167e12-caa4-4f9a-844d-f39d3eec78d7 None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:35.727698 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application [None req-46167e12-caa4-4f9a-844d-f39d3eec78d7 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 26 14:39:35.727698 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:39:35.727698 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 14:39:35.727698 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 14:39:35.727698 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 14:39:35.727698 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 14:39:35.727698 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 14:39:35.727698 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 14:39:35.727698 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 26 14:39:35.727698 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Jul 26 14:39:35.727698 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 14:39:35.727698 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Jul 26 14:39:35.727698 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:39:35.727698 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:39:35.727698 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:39:35.727698 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:39:35.727698 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:39:35.728978 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:39:35.728978 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:39:35.728978 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:39:35.728978 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:39:35.728978 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:39:35.728978 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:39:35.728978 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 14:39:35.728978 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 14:39:35.728978 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 14:39:35.728978 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 14:39:35.728978 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:39:35.728978 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:39:35.728978 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:39:35.728978 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:39:35.728978 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:39:35.728978 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:39:35.730009 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:39:35.730009 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application with Lock( Jul 26 14:39:35.730009 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:39:35.730009 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:39:35.730009 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:39:35.730009 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:39:35.730009 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:39:35.730009 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:39:35.730009 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:39:35.730009 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:39:35.730009 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 14:39:35.730009 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 14:39:35.730009 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 26 14:39:35.730009 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Jul 26 14:39:35.734227 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 469/962] 10.222.0.93 () {56 vars in 1126 bytes} [Tue Jul 26 14:39:35 2022] GET /identity/v3/services/object-store => generated 93 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:39:35.735242 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46167e12-caa4-4f9a-844d-f39d3eec78d7 None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:35.760467 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:35.780106 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dc804f-9e8f-4ede-8387-dab4912f3db0 None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:35.833848 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a91a5f5-e18f-43b6-befa-7b7d590dfb9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:35.834617 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a91a5f5-e18f-43b6-befa-7b7d590dfb9b None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:35.835163 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a91a5f5-e18f-43b6-befa-7b7d590dfb9b None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:35.835499 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a91a5f5-e18f-43b6-befa-7b7d590dfb9b None admin] PATH_INFO: `/v3/services` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:35.836221 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a91a5f5-e18f-43b6-befa-7b7d590dfb9b None admin] RBAC: Adding query filter params (type=compute) {{(pid=87056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:39:35.836533 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a91a5f5-e18f-43b6-befa-7b7d590dfb9b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:35.837987 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a91a5f5-e18f-43b6-befa-7b7d590dfb9b None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:35.841171 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:35.850274 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 494/963] 10.222.0.93 () {56 vars in 1112 bytes} [Tue Jul 26 14:39:35 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:39:35.850274 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a91a5f5-e18f-43b6-befa-7b7d590dfb9b None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:35.877561 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46167e12-caa4-4f9a-844d-f39d3eec78d7 None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:35.942365 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c71b9c-1712-4e5f-af1e-43be7585a1ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:35.943592 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c71b9c-1712-4e5f-af1e-43be7585a1ce None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:35.944121 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c71b9c-1712-4e5f-af1e-43be7585a1ce None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:35.944642 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c71b9c-1712-4e5f-af1e-43be7585a1ce None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:35.960727 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c71b9c-1712-4e5f-af1e-43be7585a1ce None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:35.963407 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c71b9c-1712-4e5f-af1e-43be7585a1ce None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:35.992894 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application [None req-a9c71b9c-1712-4e5f-af1e-43be7585a1ce None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 26 14:39:35.992894 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:39:35.992894 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:39:35.992894 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:39:35.992894 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:39:35.992894 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:39:35.992894 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:39:35.992894 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:39:35.992894 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:39:35.992894 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:39:35.992894 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:39:35.992894 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:39:35.992894 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 14:39:35.992894 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 14:39:35.992894 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 14:39:35.992894 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 14:39:35.993924 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:39:35.993924 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:39:35.993924 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 14:39:35.993924 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 14:39:35.993924 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 14:39:35.993924 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 14:39:35.993924 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:39:35.993924 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:39:35.993924 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:39:35.993924 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:39:35.993924 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:39:35.993924 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application with Lock( Jul 26 14:39:35.993924 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:39:35.993924 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:39:35.993924 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:39:35.993924 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:39:35.993924 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:39:35.993924 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:39:35.994900 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:39:35.994900 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:39:35.994900 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 14:39:35.994900 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 14:39:35.994900 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 14:39:35.994900 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 14:39:35.994900 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 14:39:35.994900 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 14:39:35.994900 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 26 14:39:35.994900 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Jul 26 14:39:35.995551 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 470/964] 10.222.0.93 () {56 vars in 1117 bytes} [Tue Jul 26 14:39:35 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:39:36.004846 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c71b9c-1712-4e5f-af1e-43be7585a1ce None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:36.043322 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a91a5f5-e18f-43b6-befa-7b7d590dfb9b None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:36.100931 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6409d12-0cb8-4e50-ab83-2793c31f4344 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:36.101701 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6409d12-0cb8-4e50-ab83-2793c31f4344 None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:36.101990 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6409d12-0cb8-4e50-ab83-2793c31f4344 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:36.102750 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6409d12-0cb8-4e50-ab83-2793c31f4344 None admin] PATH_INFO: `/v3/services` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:36.103760 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6409d12-0cb8-4e50-ab83-2793c31f4344 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=87056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:39:36.104078 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6409d12-0cb8-4e50-ab83-2793c31f4344 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:36.105738 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6409d12-0cb8-4e50-ab83-2793c31f4344 None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:36.112987 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 495/965] 10.222.0.93 () {56 vars in 1122 bytes} [Tue Jul 26 14:39:35 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:39:36.119154 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6409d12-0cb8-4e50-ab83-2793c31f4344 None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:36.138028 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:36.170625 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c71b9c-1712-4e5f-af1e-43be7585a1ce None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:36.207068 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:36.214559 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b346485-a986-4632-a845-15aaed5f8fbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:36.215773 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b346485-a986-4632-a845-15aaed5f8fbe None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:36.216278 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b346485-a986-4632-a845-15aaed5f8fbe None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:36.216737 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b346485-a986-4632-a845-15aaed5f8fbe None admin] PATH_INFO: `/v3/users` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:36.218500 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b346485-a986-4632-a845-15aaed5f8fbe None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=87055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:39:36.219061 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b346485-a986-4632-a845-15aaed5f8fbe None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:36.221296 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b346485-a986-4632-a845-15aaed5f8fbe None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:36.248744 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 471/966] 10.222.0.93 () {56 vars in 1149 bytes} [Tue Jul 26 14:39:36 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:39:36.259739 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b346485-a986-4632-a845-15aaed5f8fbe None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:36.284294 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6409d12-0cb8-4e50-ab83-2793c31f4344 None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:36.327915 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74338f5e-e300-4e78-8c27-9ec3d6c7c760 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:36.328972 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74338f5e-e300-4e78-8c27-9ec3d6c7c760 None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:36.329526 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74338f5e-e300-4e78-8c27-9ec3d6c7c760 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:36.330006 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74338f5e-e300-4e78-8c27-9ec3d6c7c760 None admin] PATH_INFO: `/v3/services` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:36.330975 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74338f5e-e300-4e78-8c27-9ec3d6c7c760 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=87056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:39:36.331627 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74338f5e-e300-4e78-8c27-9ec3d6c7c760 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:36.333902 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74338f5e-e300-4e78-8c27-9ec3d6c7c760 None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:36.340628 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 496/967] 10.222.0.93 () {56 vars in 1122 bytes} [Tue Jul 26 14:39:36 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:39:36.349303 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74338f5e-e300-4e78-8c27-9ec3d6c7c760 None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:36.464263 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b346485-a986-4632-a845-15aaed5f8fbe None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:36.489072 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74338f5e-e300-4e78-8c27-9ec3d6c7c760 None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:36.506863 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8995905-b3d2-4604-a822-2c008d5f8477 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:36.507901 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8995905-b3d2-4604-a822-2c008d5f8477 None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:36.508431 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8995905-b3d2-4604-a822-2c008d5f8477 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:36.508864 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8995905-b3d2-4604-a822-2c008d5f8477 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:36.513531 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:36.522461 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:36.532276 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e014b67-b44c-4c91-8521-ea78b2fff7f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:36.533031 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e014b67-b44c-4c91-8521-ea78b2fff7f3 None admin] REQUEST_METHOD: `POST` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:36.533602 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e014b67-b44c-4c91-8521-ea78b2fff7f3 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:36.533722 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e014b67-b44c-4c91-8521-ea78b2fff7f3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:36.534580 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e014b67-b44c-4c91-8521-ea78b2fff7f3 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:36.536731 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e014b67-b44c-4c91-8521-ea78b2fff7f3 None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:36.594235 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8995905-b3d2-4604-a822-2c008d5f8477 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:36.595993 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8995905-b3d2-4604-a822-2c008d5f8477 None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:36.664762 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 497/968] 10.222.0.93 () {60 vars in 1144 bytes} [Tue Jul 26 14:39:36 2022] POST /identity/v3/endpoints => generated 349 bytes in 319 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 14:39:36.785921 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 472/969] 10.222.0.93 () {58 vars in 1282 bytes} [Tue Jul 26 14:39:36 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 526 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 26 14:39:36.796368 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e014b67-b44c-4c91-8521-ea78b2fff7f3 None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:36.955909 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df4b960-1bf2-4236-9ef5-ff81b197105a None None] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:36.956365 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df4b960-1bf2-4236-9ef5-ff81b197105a None None] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:36.957141 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df4b960-1bf2-4236-9ef5-ff81b197105a None None] PATH_INFO: `/` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:36.959752 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 473/970] 10.222.0.93 () {54 vars in 926 bytes} [Tue Jul 26 14:39:36 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:39:36.966505 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8014546-2b51-45aa-aba1-96517a02b1ff None None] REQUEST_METHOD: `POST` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:36.966968 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8014546-2b51-45aa-aba1-96517a02b1ff None None] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:36.967501 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8014546-2b51-45aa-aba1-96517a02b1ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:37.009472 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e014b67-b44c-4c91-8521-ea78b2fff7f3 None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:37.013338 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.auth.core [None req-a8014546-2b51-45aa-aba1-96517a02b1ff None None] MFA Rules not processed for user `e5ef88cc058f425b882bcb87a1e1e75c`. Rule list: `[]` (Enabled: `True`). {{(pid=87055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:39:37.015946 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.fernet_utils [None req-a8014546-2b51-45aa-aba1-96517a02b1ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:39:37.064277 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3703a29-fc05-4fcb-95d0-a89bb9b37ca3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:37.067533 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3703a29-fc05-4fcb-95d0-a89bb9b37ca3 None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:37.068948 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3703a29-fc05-4fcb-95d0-a89bb9b37ca3 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:37.069716 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3703a29-fc05-4fcb-95d0-a89bb9b37ca3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:37.079226 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:37.092812 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3703a29-fc05-4fcb-95d0-a89bb9b37ca3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:37.094338 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3703a29-fc05-4fcb-95d0-a89bb9b37ca3 None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:37.115755 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application [None req-e3703a29-fc05-4fcb-95d0-a89bb9b37ca3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:39:37.115755 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:39:37.115755 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:39:37.115755 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:39:37.115755 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:39:37.115755 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:39:37.115755 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:39:37.115755 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:39:37.115755 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:39:37.115755 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:39:37.115755 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:39:37.115755 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:39:37.115755 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 14:39:37.115755 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 14:39:37.115755 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 14:39:37.116838 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 14:39:37.116838 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:39:37.116838 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:39:37.116838 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:39:37.116838 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:39:37.116838 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:39:37.116838 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:39:37.116838 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:39:37.116838 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application with Lock( Jul 26 14:39:37.116838 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:39:37.116838 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:39:37.116838 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:39:37.116838 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:39:37.116838 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:39:37.116838 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:39:37.116838 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:39:37.116838 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:39:37.117751 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 14:39:37.117751 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 14:39:37.117751 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:39:37.117751 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Jul 26 14:39:37.117751 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 498/971] 10.222.0.93 () {56 vars in 1108 bytes} [Tue Jul 26 14:39:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 323 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:39:37.126642 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3703a29-fc05-4fcb-95d0-a89bb9b37ca3 None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:37.167901 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 474/972] 10.222.0.93 () {58 vars in 1023 bytes} [Tue Jul 26 14:39:36 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 14:39:37.180063 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:37.208013 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8014546-2b51-45aa-aba1-96517a02b1ff None None] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:37.310908 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3703a29-fc05-4fcb-95d0-a89bb9b37ca3 None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:37.387216 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f2e60a-b4b4-4176-871f-caaef14596c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:37.388586 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f2e60a-b4b4-4176-871f-caaef14596c0 None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:37.391201 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f2e60a-b4b4-4176-871f-caaef14596c0 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:37.391201 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f2e60a-b4b4-4176-871f-caaef14596c0 None admin] PATH_INFO: `/v3/domains` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:37.392852 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f2e60a-b4b4-4176-871f-caaef14596c0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:39:37.393569 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f2e60a-b4b4-4176-871f-caaef14596c0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:37.397359 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f2e60a-b4b4-4176-871f-caaef14596c0 None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:37.406874 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8014546-2b51-45aa-aba1-96517a02b1ff None None] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:37.427131 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 499/973] 10.222.0.93 () {56 vars in 1109 bytes} [Tue Jul 26 14:39:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:39:37.432718 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f2e60a-b4b4-4176-871f-caaef14596c0 None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:37.477107 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2259d3b-7ba5-45ec-86fa-4ce6df789719 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:37.478208 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2259d3b-7ba5-45ec-86fa-4ce6df789719 None admin] REQUEST_METHOD: `POST` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:37.478798 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2259d3b-7ba5-45ec-86fa-4ce6df789719 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:37.479389 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2259d3b-7ba5-45ec-86fa-4ce6df789719 None admin] PATH_INFO: `/v3/users` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:37.480749 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2259d3b-7ba5-45ec-86fa-4ce6df789719 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:37.483391 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2259d3b-7ba5-45ec-86fa-4ce6df789719 None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:37.555558 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.sql.core [None req-a2259d3b-7ba5-45ec-86fa-4ce6df789719 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 26 14:39:37.555558 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 26 14:39:37.555558 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [parameters: {'user_id': '0d32b82462894560a90b7c149a1bbb14', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 26 14:39:37.555558 dv-cinder-851030-1-smb devstack@keystone.service[87055]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=87055) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 26 14:39:37.562493 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application [None req-a2259d3b-7ba5-45ec-86fa-4ce6df789719 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 26 14:39:37.562493 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:39:37.562493 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 26 14:39:37.562493 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 26 14:39:37.562493 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 26 14:39:37.562493 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 26 14:39:37.562493 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 26 14:39:37.562493 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application result = self._query(query) Jul 26 14:39:37.562493 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 26 14:39:37.562493 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application conn.query(q) Jul 26 14:39:37.562493 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 26 14:39:37.562493 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 26 14:39:37.562493 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 26 14:39:37.562493 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application result.read() Jul 26 14:39:37.562493 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 26 14:39:37.564202 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 26 14:39:37.564202 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 26 14:39:37.564202 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 26 14:39:37.564202 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 26 14:39:37.564202 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 26 14:39:37.564202 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 26 14:39:37.564202 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 26 14:39:37.564202 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 26 14:39:37.564202 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Jul 26 14:39:37.564202 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 26 14:39:37.564202 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Jul 26 14:39:37.564202 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:39:37.564202 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 26 14:39:37.564202 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 26 14:39:37.564202 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jul 26 14:39:37.564202 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jul 26 14:39:37.564202 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 26 14:39:37.564202 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application next(self.gen) Jul 26 14:39:37.566193 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 26 14:39:37.566193 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application yield resource Jul 26 14:39:37.566193 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 26 14:39:37.566193 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application next(self.gen) Jul 26 14:39:37.566193 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 26 14:39:37.566193 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application self.session.rollback() Jul 26 14:39:37.566193 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 26 14:39:37.566193 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application self.force_reraise() Jul 26 14:39:37.566193 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 26 14:39:37.566193 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application raise self.value Jul 26 14:39:37.566193 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 26 14:39:37.566193 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 26 14:39:37.566193 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 26 14:39:37.566193 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application session.commit() Jul 26 14:39:37.566193 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 26 14:39:37.566193 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 26 14:39:37.566193 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 26 14:39:37.575926 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application self._prepare_impl() Jul 26 14:39:37.575926 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 26 14:39:37.575926 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application self.session.flush() Jul 26 14:39:37.575926 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 26 14:39:37.575926 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application self._flush(objects) Jul 26 14:39:37.575926 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 26 14:39:37.575926 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 26 14:39:37.575926 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 26 14:39:37.575926 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application compat.raise_( Jul 26 14:39:37.575926 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 26 14:39:37.575926 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application raise exception Jul 26 14:39:37.575926 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 26 14:39:37.575926 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application flush_context.execute() Jul 26 14:39:37.575926 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 26 14:39:37.575926 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application rec.execute(self) Jul 26 14:39:37.575926 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 26 14:39:37.575926 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 26 14:39:37.577618 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 26 14:39:37.577618 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 26 14:39:37.577618 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 26 14:39:37.577618 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application result = connection._execute_20( Jul 26 14:39:37.577618 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 26 14:39:37.577618 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 26 14:39:37.577618 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 26 14:39:37.577618 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 26 14:39:37.577618 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 26 14:39:37.577618 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 26 14:39:37.577618 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 26 14:39:37.577618 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 26 14:39:37.577618 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 26 14:39:37.577618 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 26 14:39:37.577618 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 26 14:39:37.577618 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application raise exception Jul 26 14:39:37.579692 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 26 14:39:37.579692 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 26 14:39:37.579692 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 26 14:39:37.579692 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 26 14:39:37.579692 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 26 14:39:37.579692 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application result = self._query(query) Jul 26 14:39:37.579692 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 26 14:39:37.579692 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application conn.query(q) Jul 26 14:39:37.579692 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 26 14:39:37.579692 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 26 14:39:37.579692 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 26 14:39:37.579692 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application result.read() Jul 26 14:39:37.579692 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 26 14:39:37.579692 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 26 14:39:37.579692 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 26 14:39:37.579692 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 26 14:39:37.582147 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 26 14:39:37.582147 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 26 14:39:37.582147 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 26 14:39:37.582147 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 26 14:39:37.582147 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 26 14:39:37.582147 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 26 14:39:37.582147 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application [parameters: {'user_id': '0d32b82462894560a90b7c149a1bbb14', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 26 14:39:37.582147 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 26 14:39:37.582147 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Jul 26 14:39:37.582147 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 14:39:37.582147 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Jul 26 14:39:37.582147 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:39:37.582147 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:39:37.582147 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:39:37.582147 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:39:37.584122 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:39:37.584122 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:39:37.584122 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:39:37.584122 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:39:37.584122 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:39:37.584122 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:39:37.584122 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:39:37.584122 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jul 26 14:39:37.584122 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jul 26 14:39:37.584122 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:39:37.584122 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:39:37.584122 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 14:39:37.584122 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 14:39:37.584122 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 14:39:37.584122 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 14:39:37.584122 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jul 26 14:39:37.584122 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jul 26 14:39:37.586044 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jul 26 14:39:37.586044 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jul 26 14:39:37.586044 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 26 14:39:37.586044 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 26 14:39:37.586044 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 26 14:39:37.586044 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Jul 26 14:39:37.586044 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 475/974] 10.222.0.93 () {60 vars in 1131 bytes} [Tue Jul 26 14:39:37 2022] POST /identity/v3/users => generated 160 bytes in 358 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jul 26 14:39:37.586044 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2259d3b-7ba5-45ec-86fa-4ce6df789719 None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:37.622302 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:37.634005 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:37.649816 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f2e60a-b4b4-4176-871f-caaef14596c0 None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:37.730574 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec76d70f-1260-47a5-8f24-0c0c60715fd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:37.731976 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec76d70f-1260-47a5-8f24-0c0c60715fd9 None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:37.732591 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec76d70f-1260-47a5-8f24-0c0c60715fd9 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:37.733209 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec76d70f-1260-47a5-8f24-0c0c60715fd9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:37.745977 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec76d70f-1260-47a5-8f24-0c0c60715fd9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:37.747525 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec76d70f-1260-47a5-8f24-0c0c60715fd9 None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:37.761893 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application [None req-ec76d70f-1260-47a5-8f24-0c0c60715fd9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 14:39:37.761893 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:39:37.761893 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:39:37.761893 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:39:37.761893 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:39:37.761893 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:39:37.761893 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:39:37.761893 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:39:37.761893 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:39:37.761893 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:39:37.761893 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:39:37.761893 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:39:37.761893 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 14:39:37.761893 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 14:39:37.761893 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 14:39:37.763005 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 14:39:37.763005 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:39:37.763005 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:39:37.763005 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:39:37.763005 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:39:37.763005 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:39:37.763005 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:39:37.763005 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:39:37.763005 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application with Lock( Jul 26 14:39:37.763005 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:39:37.763005 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:39:37.763005 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:39:37.763005 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:39:37.763005 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:39:37.763005 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:39:37.763005 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:39:37.763005 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:39:37.763979 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 14:39:37.763979 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 14:39:37.763979 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 14:39:37.763979 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 14:39:37.763979 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 14:39:37.763979 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 14:39:37.763979 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 14:39:37.763979 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Jul 26 14:39:37.768491 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 500/975] 10.222.0.93 () {56 vars in 1111 bytes} [Tue Jul 26 14:39:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 337 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:39:37.770715 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec76d70f-1260-47a5-8f24-0c0c60715fd9 None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:37.781119 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2259d3b-7ba5-45ec-86fa-4ce6df789719 None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:37.847874 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06266ae-3692-497c-b752-b7c6af6b1ee3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:37.848946 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06266ae-3692-497c-b752-b7c6af6b1ee3 None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:37.848946 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06266ae-3692-497c-b752-b7c6af6b1ee3 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:37.848946 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06266ae-3692-497c-b752-b7c6af6b1ee3 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:37.860430 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06266ae-3692-497c-b752-b7c6af6b1ee3 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:37.862478 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06266ae-3692-497c-b752-b7c6af6b1ee3 None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:37.880281 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application [None req-b06266ae-3692-497c-b752-b7c6af6b1ee3 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 26 14:39:37.880281 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:39:37.880281 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:39:37.880281 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:39:37.880281 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:39:37.880281 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:39:37.880281 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:39:37.880281 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:39:37.880281 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:39:37.880281 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:39:37.880281 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:39:37.880281 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:39:37.880281 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 14:39:37.880281 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 14:39:37.880281 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 14:39:37.880281 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 14:39:37.881597 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:39:37.881597 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:39:37.881597 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 14:39:37.881597 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 14:39:37.881597 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 14:39:37.881597 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 14:39:37.881597 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:39:37.881597 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:39:37.881597 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:39:37.881597 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:39:37.881597 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:39:37.881597 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application with Lock( Jul 26 14:39:37.881597 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:39:37.881597 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:39:37.881597 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:39:37.881597 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:39:37.881597 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:39:37.881597 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:39:37.883293 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:39:37.883293 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:39:37.883293 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 14:39:37.883293 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 14:39:37.883293 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 14:39:37.883293 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 14:39:37.883293 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 14:39:37.883293 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 14:39:37.883293 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 26 14:39:37.883293 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Jul 26 14:39:37.883293 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 476/976] 10.222.0.93 () {56 vars in 1099 bytes} [Tue Jul 26 14:39:37 2022] GET /identity/v3/users/cinder => generated 84 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:39:37.892264 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06266ae-3692-497c-b752-b7c6af6b1ee3 None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:37.927533 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec76d70f-1260-47a5-8f24-0c0c60715fd9 None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:37.994321 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35262003-4a8c-44e3-9f63-d3e980591a48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:37.995621 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35262003-4a8c-44e3-9f63-d3e980591a48 None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:37.996196 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35262003-4a8c-44e3-9f63-d3e980591a48 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:37.996758 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35262003-4a8c-44e3-9f63-d3e980591a48 None admin] PATH_INFO: `/v3/projects` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:37.998682 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35262003-4a8c-44e3-9f63-d3e980591a48 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:39:37.999116 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35262003-4a8c-44e3-9f63-d3e980591a48 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:38.002005 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35262003-4a8c-44e3-9f63-d3e980591a48 None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:38.028306 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 501/977] 10.222.0.93 () {56 vars in 1148 bytes} [Tue Jul 26 14:39:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:39:38.038279 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35262003-4a8c-44e3-9f63-d3e980591a48 None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:38.056050 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:38.071678 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:38.074744 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06266ae-3692-497c-b752-b7c6af6b1ee3 None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:38.129298 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4a508d-9d70-4db4-9650-60dad3d498a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:38.130287 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4a508d-9d70-4db4-9650-60dad3d498a2 None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:38.130563 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4a508d-9d70-4db4-9650-60dad3d498a2 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:38.130853 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4a508d-9d70-4db4-9650-60dad3d498a2 None admin] PATH_INFO: `/v3/users` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:38.132115 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4a508d-9d70-4db4-9650-60dad3d498a2 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=87055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:39:38.132618 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4a508d-9d70-4db4-9650-60dad3d498a2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:38.134573 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4a508d-9d70-4db4-9650-60dad3d498a2 None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:38.190703 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 477/978] 10.222.0.93 () {56 vars in 1101 bytes} [Tue Jul 26 14:39:37 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:39:38.268605 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35262003-4a8c-44e3-9f63-d3e980591a48 None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:38.348639 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48321c1a-6e42-4532-b91c-7ee48b71e97d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:38.350209 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48321c1a-6e42-4532-b91c-7ee48b71e97d None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:38.350953 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48321c1a-6e42-4532-b91c-7ee48b71e97d None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:38.351710 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48321c1a-6e42-4532-b91c-7ee48b71e97d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:38.353453 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48321c1a-6e42-4532-b91c-7ee48b71e97d None admin] RBAC: Adding query filter params (role.id=fb41e639164e46ba82e91c6a63dd4898, scope.project.id=c422a2290a14424da20e2841cbc1741d, user.id=0205dfcfb5e5404c95aefc1f45a1e1e6) {{(pid=87056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:39:38.354347 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48321c1a-6e42-4532-b91c-7ee48b71e97d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:38.357451 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48321c1a-6e42-4532-b91c-7ee48b71e97d None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:38.371001 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 502/979] 10.222.0.93 () {56 vars in 1374 bytes} [Tue Jul 26 14:39:38 2022] GET /identity/v3/role_assignments?user.id=0205dfcfb5e5404c95aefc1f45a1e1e6&scope.project.id=c422a2290a14424da20e2841cbc1741d&role.id=fb41e639164e46ba82e91c6a63dd4898 => generated 608 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:39:38.790978 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1560125c-026f-4ec0-9496-c37f4bbf0c53 None None] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:38.791455 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1560125c-026f-4ec0-9496-c37f4bbf0c53 None None] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:38.791933 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1560125c-026f-4ec0-9496-c37f4bbf0c53 None None] PATH_INFO: `/` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:38.794892 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 478/980] 10.222.0.93 () {54 vars in 926 bytes} [Tue Jul 26 14:39:38 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:39:38.805236 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da88be77-b5de-430d-b312-7bf9d2eafd9b None None] REQUEST_METHOD: `POST` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:38.806013 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da88be77-b5de-430d-b312-7bf9d2eafd9b None None] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:38.806467 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da88be77-b5de-430d-b312-7bf9d2eafd9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:38.839789 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.auth.core [None req-da88be77-b5de-430d-b312-7bf9d2eafd9b None None] MFA Rules not processed for user `e5ef88cc058f425b882bcb87a1e1e75c`. Rule list: `[]` (Enabled: `True`). {{(pid=87056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:39:38.841892 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.fernet_utils [None req-da88be77-b5de-430d-b312-7bf9d2eafd9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:39:38.982670 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 503/981] 10.222.0.93 () {58 vars in 1023 bytes} [Tue Jul 26 14:39:38 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 14:39:39.020466 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1560125c-026f-4ec0-9496-c37f4bbf0c53 None None] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:39.190943 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1560125c-026f-4ec0-9496-c37f4bbf0c53 None None] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:39.236162 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f217c28e-fe80-4da7-b9d0-d00b075004de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:39.236893 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f217c28e-fe80-4da7-b9d0-d00b075004de None admin] REQUEST_METHOD: `POST` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:39.237311 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f217c28e-fe80-4da7-b9d0-d00b075004de None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:39.237707 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f217c28e-fe80-4da7-b9d0-d00b075004de None admin] PATH_INFO: `/v3/services` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:39.238904 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f217c28e-fe80-4da7-b9d0-d00b075004de None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:39.240608 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f217c28e-fe80-4da7-b9d0-d00b075004de None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:39.352365 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 479/982] 10.222.0.93 () {60 vars in 1141 bytes} [Tue Jul 26 14:39:39 2022] POST /identity/v3/services => generated 242 bytes in 334 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 14:39:39.530509 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1081d6-dbe8-42a3-8de8-c188b22efeff None None] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:39.530692 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1081d6-dbe8-42a3-8de8-c188b22efeff None None] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:39.530994 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1081d6-dbe8-42a3-8de8-c188b22efeff None None] PATH_INFO: `/` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:39.532925 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 504/983] 10.222.0.93 () {54 vars in 926 bytes} [Tue Jul 26 14:39:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:39:39.540978 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc9bb6e-6eb4-4145-b16c-700ea5eeb966 None None] REQUEST_METHOD: `POST` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:39.541294 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc9bb6e-6eb4-4145-b16c-700ea5eeb966 None None] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:39.541546 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc9bb6e-6eb4-4145-b16c-700ea5eeb966 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:39.563082 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:39.570601 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.auth.core [None req-8fc9bb6e-6eb4-4145-b16c-700ea5eeb966 None None] MFA Rules not processed for user `e5ef88cc058f425b882bcb87a1e1e75c`. Rule list: `[]` (Enabled: `True`). {{(pid=87055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:39:39.576235 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.fernet_utils [None req-8fc9bb6e-6eb4-4145-b16c-700ea5eeb966 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:39:39.710315 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 480/984] 10.222.0.93 () {58 vars in 1023 bytes} [Tue Jul 26 14:39:39 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 14:39:39.747403 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1081d6-dbe8-42a3-8de8-c188b22efeff None None] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:39.764142 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:39.918265 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1081d6-dbe8-42a3-8de8-c188b22efeff None None] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:39.969723 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d362da39-b6e8-46b6-a9cb-dcccbf17d008 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:39.970776 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d362da39-b6e8-46b6-a9cb-dcccbf17d008 None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:39.971065 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d362da39-b6e8-46b6-a9cb-dcccbf17d008 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:39.971514 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d362da39-b6e8-46b6-a9cb-dcccbf17d008 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:39.973224 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d362da39-b6e8-46b6-a9cb-dcccbf17d008 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:39.975846 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d362da39-b6e8-46b6-a9cb-dcccbf17d008 None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:39.991430 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application [None req-d362da39-b6e8-46b6-a9cb-dcccbf17d008 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 26 14:39:39.991430 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:39:39.991430 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 14:39:39.991430 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 14:39:39.991430 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 14:39:39.991430 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 14:39:39.991430 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 14:39:39.991430 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 14:39:39.991430 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 26 14:39:39.991430 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Jul 26 14:39:39.991430 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 14:39:39.991430 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Jul 26 14:39:39.991430 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:39:39.991430 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:39:39.991430 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:39:39.991430 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:39:39.991430 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:39:39.993383 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:39:39.993383 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:39:39.993383 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:39:39.993383 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:39:39.993383 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:39:39.993383 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:39:39.993383 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 14:39:39.993383 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 14:39:39.993383 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 14:39:39.993383 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 14:39:39.993383 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:39:39.993383 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:39:39.993383 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:39:39.993383 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:39:39.993383 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:39:39.993383 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:39:39.995710 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:39:39.995710 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application with Lock( Jul 26 14:39:39.995710 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:39:39.995710 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:39:39.995710 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:39:39.995710 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:39:39.995710 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:39:39.995710 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:39:39.995710 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:39:39.995710 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:39:39.995710 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 14:39:39.995710 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 14:39:39.995710 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 26 14:39:39.995710 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Jul 26 14:39:39.998385 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 505/985] 10.222.0.93 () {56 vars in 1126 bytes} [Tue Jul 26 14:39:39 2022] GET /identity/v3/services/object-store => generated 93 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:39:40.000666 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc9bb6e-6eb4-4145-b16c-700ea5eeb966 None None] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:40.202536 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc9bb6e-6eb4-4145-b16c-700ea5eeb966 None None] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:40.241439 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:40.248150 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde97e82-3c26-41e8-a3ab-49fb4c744542 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:40.248792 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde97e82-3c26-41e8-a3ab-49fb4c744542 None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:40.249086 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde97e82-3c26-41e8-a3ab-49fb4c744542 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:40.249413 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde97e82-3c26-41e8-a3ab-49fb4c744542 None admin] PATH_INFO: `/v3/services` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:40.250088 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde97e82-3c26-41e8-a3ab-49fb4c744542 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=87055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:39:40.250405 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde97e82-3c26-41e8-a3ab-49fb4c744542 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:40.256758 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde97e82-3c26-41e8-a3ab-49fb4c744542 None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:40.264452 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 481/986] 10.222.0.93 () {56 vars in 1122 bytes} [Tue Jul 26 14:39:39 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:39:40.265937 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d362da39-b6e8-46b6-a9cb-dcccbf17d008 None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:40.357894 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:40.397958 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d362da39-b6e8-46b6-a9cb-dcccbf17d008 None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:40.445058 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b660e48-8dd8-48dc-97f9-2f83e5cd6178 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:40.445889 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b660e48-8dd8-48dc-97f9-2f83e5cd6178 None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:40.446342 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b660e48-8dd8-48dc-97f9-2f83e5cd6178 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:40.446747 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b660e48-8dd8-48dc-97f9-2f83e5cd6178 None admin] PATH_INFO: `/v3/services` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:40.447581 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b660e48-8dd8-48dc-97f9-2f83e5cd6178 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=87056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:39:40.448022 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b660e48-8dd8-48dc-97f9-2f83e5cd6178 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:40.449941 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b660e48-8dd8-48dc-97f9-2f83e5cd6178 None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:40.462464 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 506/987] 10.222.0.93 () {56 vars in 1122 bytes} [Tue Jul 26 14:39:40 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:39:40.465325 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde97e82-3c26-41e8-a3ab-49fb4c744542 None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:40.617165 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde97e82-3c26-41e8-a3ab-49fb4c744542 None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:40.693592 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5345684-93c2-4895-9fa3-d98f0ca3b4ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:40.695370 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5345684-93c2-4895-9fa3-d98f0ca3b4ce None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:40.695370 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5345684-93c2-4895-9fa3-d98f0ca3b4ce None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:40.695753 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5345684-93c2-4895-9fa3-d98f0ca3b4ce None admin] PATH_INFO: `/v3/endpoints` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:40.697152 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5345684-93c2-4895-9fa3-d98f0ca3b4ce None admin] RBAC: Adding query filter params (interface=admin, service_id=9313a0c835864357b53e5a10dbb5fd45, region_id=RegionOne) {{(pid=87055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:39:40.697702 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5345684-93c2-4895-9fa3-d98f0ca3b4ce None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:40.700456 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5345684-93c2-4895-9fa3-d98f0ca3b4ce None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:40.718495 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 482/988] 10.222.0.93 () {56 vars in 1249 bytes} [Tue Jul 26 14:39:40 2022] GET /identity/v3/endpoints?service_id=9313a0c835864357b53e5a10dbb5fd45&interface=admin®ion_id=RegionOne => generated 193 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:39:40.721866 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b660e48-8dd8-48dc-97f9-2f83e5cd6178 None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:40.934588 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b660e48-8dd8-48dc-97f9-2f83e5cd6178 None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:41.003354 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f790fdcc-7848-49d7-9637-ad2fa3a44bad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:41.004359 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f790fdcc-7848-49d7-9637-ad2fa3a44bad None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:41.004861 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f790fdcc-7848-49d7-9637-ad2fa3a44bad None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:41.005359 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f790fdcc-7848-49d7-9637-ad2fa3a44bad None admin] PATH_INFO: `/v3/services` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:41.006673 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f790fdcc-7848-49d7-9637-ad2fa3a44bad None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:41.009257 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f790fdcc-7848-49d7-9637-ad2fa3a44bad None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:41.011632 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:41.023926 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 507/989] 10.222.0.93 () {56 vars in 1087 bytes} [Tue Jul 26 14:39:40 2022] GET /identity/v3/services => generated 1727 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 14:39:41.276147 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c2fcdc-c104-43ee-8a9f-a2a54e2334f6 None None] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:41.276896 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c2fcdc-c104-43ee-8a9f-a2a54e2334f6 None None] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:41.276896 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c2fcdc-c104-43ee-8a9f-a2a54e2334f6 None None] PATH_INFO: `/` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:41.278234 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 483/990] 10.222.0.93 () {54 vars in 926 bytes} [Tue Jul 26 14:39:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 14:39:41.284236 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc751ad-28b7-4997-bd4c-85169c8e55b1 None None] REQUEST_METHOD: `POST` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:41.284631 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc751ad-28b7-4997-bd4c-85169c8e55b1 None None] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:41.285409 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc751ad-28b7-4997-bd4c-85169c8e55b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:41.305935 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.auth.core [None req-8bc751ad-28b7-4997-bd4c-85169c8e55b1 None None] MFA Rules not processed for user `e5ef88cc058f425b882bcb87a1e1e75c`. Rule list: `[]` (Enabled: `True`). {{(pid=87056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:39:41.307188 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.fernet_utils [None req-8bc751ad-28b7-4997-bd4c-85169c8e55b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:39:41.405602 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 508/991] 10.222.0.93 () {58 vars in 1023 bytes} [Tue Jul 26 14:39:41 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 14:39:41.432990 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c2fcdc-c104-43ee-8a9f-a2a54e2334f6 None None] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:41.556631 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:41.636681 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c2fcdc-c104-43ee-8a9f-a2a54e2334f6 None None] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:41.698679 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afa0bc4-cef3-4bd9-a31d-64ab6b739683 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:41.699354 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afa0bc4-cef3-4bd9-a31d-64ab6b739683 None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:41.699645 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afa0bc4-cef3-4bd9-a31d-64ab6b739683 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:41.699960 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afa0bc4-cef3-4bd9-a31d-64ab6b739683 None admin] PATH_INFO: `/v3/services/image` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:41.700541 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afa0bc4-cef3-4bd9-a31d-64ab6b739683 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:41.701961 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afa0bc4-cef3-4bd9-a31d-64ab6b739683 None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:41.712698 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application [None req-2afa0bc4-cef3-4bd9-a31d-64ab6b739683 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 26 14:39:41.712698 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:39:41.712698 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 14:39:41.712698 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 14:39:41.712698 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 14:39:41.712698 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 14:39:41.712698 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 14:39:41.712698 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 14:39:41.712698 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 26 14:39:41.712698 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Jul 26 14:39:41.712698 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 14:39:41.712698 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Jul 26 14:39:41.712698 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:39:41.712698 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:39:41.712698 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:39:41.712698 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:39:41.712698 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:39:41.715228 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:39:41.715228 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:39:41.715228 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:39:41.715228 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:39:41.715228 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:39:41.715228 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:39:41.715228 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 14:39:41.715228 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 14:39:41.715228 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 14:39:41.715228 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 14:39:41.715228 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:39:41.715228 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:39:41.715228 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:39:41.715228 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:39:41.715228 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:39:41.715228 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:39:41.716836 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:39:41.716836 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application with Lock( Jul 26 14:39:41.716836 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:39:41.716836 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:39:41.716836 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:39:41.716836 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:39:41.716836 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:39:41.716836 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:39:41.716836 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:39:41.716836 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:39:41.716836 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 14:39:41.716836 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 14:39:41.716836 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 26 14:39:41.716836 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Jul 26 14:39:41.719201 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 484/992] 10.222.0.93 () {56 vars in 1105 bytes} [Tue Jul 26 14:39:41 2022] GET /identity/v3/services/image => generated 86 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 14:39:41.721371 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc751ad-28b7-4997-bd4c-85169c8e55b1 None None] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:41.867012 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc751ad-28b7-4997-bd4c-85169c8e55b1 None None] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:41.904514 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:41.918640 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4fe6c0-c59e-42de-93a1-f6460b30d309 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:41.919789 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4fe6c0-c59e-42de-93a1-f6460b30d309 None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:41.920284 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4fe6c0-c59e-42de-93a1-f6460b30d309 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:41.920628 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4fe6c0-c59e-42de-93a1-f6460b30d309 None admin] PATH_INFO: `/v3/services` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:41.921904 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4fe6c0-c59e-42de-93a1-f6460b30d309 None admin] RBAC: Adding query filter params (name=image) {{(pid=87056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:39:41.922571 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4fe6c0-c59e-42de-93a1-f6460b30d309 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:41.925148 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4fe6c0-c59e-42de-93a1-f6460b30d309 None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:41.940937 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 509/993] 10.222.0.93 () {56 vars in 1108 bytes} [Tue Jul 26 14:39:41 2022] GET /identity/v3/services?name=image => generated 122 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:39:41.944831 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afa0bc4-cef3-4bd9-a31d-64ab6b739683 None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:42.089527 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afa0bc4-cef3-4bd9-a31d-64ab6b739683 None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:42.122992 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:42.137424 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986f1aeb-12b0-4439-b354-2f5937807840 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:42.138062 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986f1aeb-12b0-4439-b354-2f5937807840 None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:42.138499 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986f1aeb-12b0-4439-b354-2f5937807840 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:42.138783 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986f1aeb-12b0-4439-b354-2f5937807840 None admin] PATH_INFO: `/v3/services` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:42.139475 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986f1aeb-12b0-4439-b354-2f5937807840 None admin] RBAC: Adding query filter params (type=image) {{(pid=87055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:39:42.139778 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986f1aeb-12b0-4439-b354-2f5937807840 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:42.141411 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986f1aeb-12b0-4439-b354-2f5937807840 None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:42.148641 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 485/994] 10.222.0.93 () {56 vars in 1108 bytes} [Tue Jul 26 14:39:41 2022] GET /identity/v3/services?type=image => generated 122 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:39:42.432746 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bc0573-23e3-4b27-b3c5-c6f85c987477 None None] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:42.433127 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bc0573-23e3-4b27-b3c5-c6f85c987477 None None] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:42.433576 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bc0573-23e3-4b27-b3c5-c6f85c987477 None None] PATH_INFO: `/` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:42.436297 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 510/995] 10.222.0.93 () {54 vars in 926 bytes} [Tue Jul 26 14:39:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 14:39:42.445786 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15303547-e0a8-468d-89d8-06f4bb1ff5ba None None] REQUEST_METHOD: `POST` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:42.446365 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15303547-e0a8-468d-89d8-06f4bb1ff5ba None None] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:42.446873 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15303547-e0a8-468d-89d8-06f4bb1ff5ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:42.478957 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.auth.core [None req-15303547-e0a8-468d-89d8-06f4bb1ff5ba None None] MFA Rules not processed for user `e5ef88cc058f425b882bcb87a1e1e75c`. Rule list: `[]` (Enabled: `True`). {{(pid=87055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:39:42.481428 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.fernet_utils [None req-15303547-e0a8-468d-89d8-06f4bb1ff5ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:39:42.629767 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 486/996] 10.222.0.93 () {58 vars in 1023 bytes} [Tue Jul 26 14:39:42 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 14:39:42.673774 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bc0573-23e3-4b27-b3c5-c6f85c987477 None None] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:42.886398 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bc0573-23e3-4b27-b3c5-c6f85c987477 None None] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:42.953556 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c70af50-52c3-44e5-8765-2443b55a41d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:42.954775 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c70af50-52c3-44e5-8765-2443b55a41d9 None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:42.955269 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c70af50-52c3-44e5-8765-2443b55a41d9 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:42.955769 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c70af50-52c3-44e5-8765-2443b55a41d9 None admin] PATH_INFO: `/v3/services/compute` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:42.957033 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c70af50-52c3-44e5-8765-2443b55a41d9 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:42.959547 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c70af50-52c3-44e5-8765-2443b55a41d9 None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:42.978221 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application [None req-7c70af50-52c3-44e5-8765-2443b55a41d9 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 26 14:39:42.978221 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:39:42.978221 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 14:39:42.978221 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 14:39:42.978221 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 14:39:42.978221 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 14:39:42.978221 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 14:39:42.978221 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 14:39:42.978221 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 26 14:39:42.978221 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Jul 26 14:39:42.978221 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 14:39:42.978221 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Jul 26 14:39:42.978221 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:39:42.978221 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:39:42.978221 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:39:42.978221 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:39:42.978221 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:39:42.979345 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:39:42.979345 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:39:42.979345 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:39:42.979345 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:39:42.979345 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:39:42.979345 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:39:42.979345 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 14:39:42.979345 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 14:39:42.979345 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 14:39:42.979345 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 14:39:42.979345 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:39:42.979345 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:39:42.979345 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:39:42.979345 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:39:42.979345 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:39:42.979345 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:39:42.980255 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:39:42.980255 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application with Lock( Jul 26 14:39:42.980255 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:39:42.980255 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:39:42.980255 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:39:42.980255 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:39:42.980255 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:39:42.980255 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:39:42.980255 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:39:42.980255 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:39:42.980255 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 14:39:42.980255 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 14:39:42.980255 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 26 14:39:42.980255 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Jul 26 14:39:42.982794 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 511/997] 10.222.0.93 () {56 vars in 1111 bytes} [Tue Jul 26 14:39:42 2022] GET /identity/v3/services/compute => generated 88 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:39:42.991341 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15303547-e0a8-468d-89d8-06f4bb1ff5ba None None] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:43.197769 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15303547-e0a8-468d-89d8-06f4bb1ff5ba None None] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:43.234831 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:43.268925 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca6b393-325e-4898-bce9-6a18cf28a644 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:43.270857 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca6b393-325e-4898-bce9-6a18cf28a644 None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:43.271361 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca6b393-325e-4898-bce9-6a18cf28a644 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:43.271848 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca6b393-325e-4898-bce9-6a18cf28a644 None admin] PATH_INFO: `/v3/services` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:43.273169 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca6b393-325e-4898-bce9-6a18cf28a644 None admin] RBAC: Adding query filter params (name=compute) {{(pid=87055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:39:43.273730 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca6b393-325e-4898-bce9-6a18cf28a644 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:43.276369 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca6b393-325e-4898-bce9-6a18cf28a644 None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:43.294282 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 487/998] 10.222.0.93 () {56 vars in 1112 bytes} [Tue Jul 26 14:39:42 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:39:43.298522 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c70af50-52c3-44e5-8765-2443b55a41d9 None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:43.415373 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:43.467054 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a52ec0-9b7e-4b28-87a8-f24e632c2faf None None] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:43.467592 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a52ec0-9b7e-4b28-87a8-f24e632c2faf None None] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:43.467592 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a52ec0-9b7e-4b28-87a8-f24e632c2faf None None] PATH_INFO: `/` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:43.469203 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 488/999] 10.222.0.93 () {54 vars in 926 bytes} [Tue Jul 26 14:39:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 14:39:43.475437 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cfc70c-1572-4b46-926a-9e396532b132 None None] REQUEST_METHOD: `POST` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:43.475784 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cfc70c-1572-4b46-926a-9e396532b132 None None] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:43.476001 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cfc70c-1572-4b46-926a-9e396532b132 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:43.498666 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.auth.core [None req-40cfc70c-1572-4b46-926a-9e396532b132 None None] MFA Rules not processed for user `e5ef88cc058f425b882bcb87a1e1e75c`. Rule list: `[]` (Enabled: `True`). {{(pid=87055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:39:43.499138 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c70af50-52c3-44e5-8765-2443b55a41d9 None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:43.500742 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.fernet_utils [None req-40cfc70c-1572-4b46-926a-9e396532b132 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:39:43.541808 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f537a28-0a38-4216-9f9f-efe127a403d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:43.542493 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f537a28-0a38-4216-9f9f-efe127a403d8 None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:43.542786 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f537a28-0a38-4216-9f9f-efe127a403d8 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:43.543045 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f537a28-0a38-4216-9f9f-efe127a403d8 None admin] PATH_INFO: `/v3/services` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:43.543754 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f537a28-0a38-4216-9f9f-efe127a403d8 None admin] RBAC: Adding query filter params (type=compute) {{(pid=87056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:39:43.544067 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f537a28-0a38-4216-9f9f-efe127a403d8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:43.545536 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f537a28-0a38-4216-9f9f-efe127a403d8 None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:43.558388 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 512/1000] 10.222.0.93 () {56 vars in 1112 bytes} [Tue Jul 26 14:39:43 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:39:43.560726 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f537a28-0a38-4216-9f9f-efe127a403d8 None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:43.627715 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 489/1001] 10.222.0.93 () {58 vars in 1023 bytes} [Tue Jul 26 14:39:43 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 26 14:39:43.671296 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cfc70c-1572-4b46-926a-9e396532b132 None None] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:43.748530 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f537a28-0a38-4216-9f9f-efe127a403d8 None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:43.788554 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:43.810886 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b690624-4fd1-4c0c-8ee4-16a4f578bb0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:43.811952 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b690624-4fd1-4c0c-8ee4-16a4f578bb0c None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:43.812438 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b690624-4fd1-4c0c-8ee4-16a4f578bb0c None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:43.812947 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b690624-4fd1-4c0c-8ee4-16a4f578bb0c None admin] PATH_INFO: `/v3/endpoints` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:43.814299 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b690624-4fd1-4c0c-8ee4-16a4f578bb0c None admin] RBAC: Adding query filter params (interface=public, service_id=c4fcf9d8065946428ccd9ef22982ad78, region_id=RegionOne) {{(pid=87056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:39:43.814706 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b690624-4fd1-4c0c-8ee4-16a4f578bb0c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:43.816732 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b690624-4fd1-4c0c-8ee4-16a4f578bb0c None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:43.818013 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cfc70c-1572-4b46-926a-9e396532b132 None None] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:43.829942 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 513/1002] 10.222.0.93 () {56 vars in 1251 bytes} [Tue Jul 26 14:39:43 2022] GET /identity/v3/endpoints?service_id=c4fcf9d8065946428ccd9ef22982ad78&interface=public®ion_id=RegionOne => generated 194 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:39:43.831120 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b690624-4fd1-4c0c-8ee4-16a4f578bb0c None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:43.840503 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:43.882297 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc1c92f-7675-4c60-91c0-6987fd83b781 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:43.883340 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc1c92f-7675-4c60-91c0-6987fd83b781 None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:43.883806 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc1c92f-7675-4c60-91c0-6987fd83b781 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:43.884264 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc1c92f-7675-4c60-91c0-6987fd83b781 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:43.885308 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc1c92f-7675-4c60-91c0-6987fd83b781 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:43.887782 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc1c92f-7675-4c60-91c0-6987fd83b781 None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:43.904574 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application [None req-ccc1c92f-7675-4c60-91c0-6987fd83b781 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 26 14:39:43.904574 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:39:43.904574 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 14:39:43.904574 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 14:39:43.904574 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 14:39:43.904574 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 14:39:43.904574 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 14:39:43.904574 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 14:39:43.904574 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 26 14:39:43.904574 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Jul 26 14:39:43.904574 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 14:39:43.904574 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Jul 26 14:39:43.904574 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:39:43.904574 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:39:43.904574 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:39:43.904574 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:39:43.904574 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:39:43.905674 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:39:43.905674 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:39:43.905674 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:39:43.905674 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:39:43.905674 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:39:43.905674 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:39:43.905674 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 14:39:43.905674 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 14:39:43.905674 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 14:39:43.905674 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 14:39:43.905674 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:39:43.905674 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:39:43.905674 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:39:43.905674 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:39:43.905674 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:39:43.905674 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:39:43.911018 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:39:43.911018 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application with Lock( Jul 26 14:39:43.911018 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:39:43.911018 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:39:43.911018 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:39:43.911018 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:39:43.911018 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:39:43.911018 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:39:43.911018 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:39:43.911018 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:39:43.911018 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 14:39:43.911018 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 14:39:43.911018 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 26 14:39:43.911018 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Jul 26 14:39:43.911018 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 490/1003] 10.222.0.93 () {56 vars in 1126 bytes} [Tue Jul 26 14:39:43 2022] GET /identity/v3/services/object-store => generated 93 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 14:39:43.914595 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc1c92f-7675-4c60-91c0-6987fd83b781 None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:43.995619 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b690624-4fd1-4c0c-8ee4-16a4f578bb0c None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:44.065276 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc1c92f-7675-4c60-91c0-6987fd83b781 None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:44.072391 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dc40df-824c-4f29-b732-678e7bd8956f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:44.073720 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dc40df-824c-4f29-b732-678e7bd8956f None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:44.074449 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dc40df-824c-4f29-b732-678e7bd8956f None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:44.075151 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dc40df-824c-4f29-b732-678e7bd8956f None admin] PATH_INFO: `/v3/services` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:44.076543 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57dc40df-824c-4f29-b732-678e7bd8956f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:44.079227 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57dc40df-824c-4f29-b732-678e7bd8956f None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:44.094057 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 514/1004] 10.222.0.93 () {56 vars in 1087 bytes} [Tue Jul 26 14:39:43 2022] GET /identity/v3/services => generated 1727 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 14:39:44.131167 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c692a7e7-ba66-4f02-9f30-fa9300a04389 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:44.132008 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c692a7e7-ba66-4f02-9f30-fa9300a04389 None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:44.132513 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c692a7e7-ba66-4f02-9f30-fa9300a04389 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:44.132933 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c692a7e7-ba66-4f02-9f30-fa9300a04389 None admin] PATH_INFO: `/v3/services` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:44.133799 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c692a7e7-ba66-4f02-9f30-fa9300a04389 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=87055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:39:44.134336 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c692a7e7-ba66-4f02-9f30-fa9300a04389 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:44.135966 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c692a7e7-ba66-4f02-9f30-fa9300a04389 None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:44.142854 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 491/1005] 10.222.0.93 () {56 vars in 1122 bytes} [Tue Jul 26 14:39:43 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:39:44.149254 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dc40df-824c-4f29-b732-678e7bd8956f None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:44.217731 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:44.284332 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dc40df-824c-4f29-b732-678e7bd8956f None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:44.329781 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2c80f8-35bd-4538-adfa-da65f24f32ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:44.330394 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2c80f8-35bd-4538-adfa-da65f24f32ba None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:44.330682 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2c80f8-35bd-4538-adfa-da65f24f32ba None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:44.330960 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2c80f8-35bd-4538-adfa-da65f24f32ba None admin] PATH_INFO: `/v3/services` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:44.332235 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2c80f8-35bd-4538-adfa-da65f24f32ba None admin] RBAC: Adding query filter params (type=object-store) {{(pid=87056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:39:44.332742 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2c80f8-35bd-4538-adfa-da65f24f32ba None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:44.333981 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2c80f8-35bd-4538-adfa-da65f24f32ba None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:44.340417 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 515/1006] 10.222.0.93 () {56 vars in 1122 bytes} [Tue Jul 26 14:39:44 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:39:44.346614 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c692a7e7-ba66-4f02-9f30-fa9300a04389 None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:44.401857 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:44.479102 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c692a7e7-ba66-4f02-9f30-fa9300a04389 None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:44.576931 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2729d4-282d-4d06-9e5e-5469674f560f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:44.577851 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2729d4-282d-4d06-9e5e-5469674f560f None admin] REQUEST_METHOD: `POST` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:44.578264 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2729d4-282d-4d06-9e5e-5469674f560f None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:44.578556 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2729d4-282d-4d06-9e5e-5469674f560f None admin] PATH_INFO: `/v3/endpoints` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:44.579588 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2729d4-282d-4d06-9e5e-5469674f560f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:44.581379 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2729d4-282d-4d06-9e5e-5469674f560f None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:44.774317 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 492/1007] 10.222.0.93 () {60 vars in 1144 bytes} [Tue Jul 26 14:39:44 2022] POST /identity/v3/endpoints => generated 325 bytes in 424 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 14:39:45.102436 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bedd85-48f4-4a47-b000-4ff5509b0607 None None] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:45.103207 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bedd85-48f4-4a47-b000-4ff5509b0607 None None] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:45.103581 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bedd85-48f4-4a47-b000-4ff5509b0607 None None] PATH_INFO: `/` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:45.106295 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 516/1008] 10.222.0.93 () {54 vars in 926 bytes} [Tue Jul 26 14:39:45 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:39:45.114923 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2574fdd0-faf2-4a55-997f-5c8373809c20 None None] REQUEST_METHOD: `POST` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:45.115394 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2574fdd0-faf2-4a55-997f-5c8373809c20 None None] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:45.115846 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2574fdd0-faf2-4a55-997f-5c8373809c20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:45.148098 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.auth.core [None req-2574fdd0-faf2-4a55-997f-5c8373809c20 None None] MFA Rules not processed for user `e5ef88cc058f425b882bcb87a1e1e75c`. Rule list: `[]` (Enabled: `True`). {{(pid=87055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:39:45.150308 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.fernet_utils [None req-2574fdd0-faf2-4a55-997f-5c8373809c20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:39:45.299559 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 493/1009] 10.222.0.93 () {58 vars in 1023 bytes} [Tue Jul 26 14:39:45 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 26 14:39:45.339611 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bedd85-48f4-4a47-b000-4ff5509b0607 None None] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:45.549202 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bedd85-48f4-4a47-b000-4ff5509b0607 None None] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:45.570885 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:45.603192 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986b6f92-af11-4c48-a081-83de9da9bc59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:45.603917 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986b6f92-af11-4c48-a081-83de9da9bc59 None admin] REQUEST_METHOD: `POST` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:45.604377 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986b6f92-af11-4c48-a081-83de9da9bc59 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:45.604699 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986b6f92-af11-4c48-a081-83de9da9bc59 None admin] PATH_INFO: `/v3/services` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:45.605678 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986b6f92-af11-4c48-a081-83de9da9bc59 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:45.608022 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986b6f92-af11-4c48-a081-83de9da9bc59 None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:45.714301 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 517/1010] 10.222.0.93 () {60 vars in 1141 bytes} [Tue Jul 26 14:39:45 2022] POST /identity/v3/services => generated 242 bytes in 370 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 14:39:47.146843 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d429b4a-4ba5-4fae-ae77-22d7968b4c6e None None] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:47.147375 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d429b4a-4ba5-4fae-ae77-22d7968b4c6e None None] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:47.147452 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d429b4a-4ba5-4fae-ae77-22d7968b4c6e None None] PATH_INFO: `/` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:47.149186 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 494/1011] 10.222.0.93 () {54 vars in 926 bytes} [Tue Jul 26 14:39:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:39:47.154702 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabb1cdf-0241-4ae9-95a7-dba895434b8e None None] REQUEST_METHOD: `POST` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:47.155329 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabb1cdf-0241-4ae9-95a7-dba895434b8e None None] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:47.155329 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabb1cdf-0241-4ae9-95a7-dba895434b8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:47.174912 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.auth.core [None req-cabb1cdf-0241-4ae9-95a7-dba895434b8e None None] MFA Rules not processed for user `e5ef88cc058f425b882bcb87a1e1e75c`. Rule list: `[]` (Enabled: `True`). {{(pid=87056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:39:47.176367 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.fernet_utils [None req-cabb1cdf-0241-4ae9-95a7-dba895434b8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:39:47.266677 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 518/1012] 10.222.0.93 () {58 vars in 1023 bytes} [Tue Jul 26 14:39:47 2022] POST /identity/v3/auth/tokens => generated 1803 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 26 14:39:47.292306 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d429b4a-4ba5-4fae-ae77-22d7968b4c6e None None] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:47.327808 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:47.427196 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d429b4a-4ba5-4fae-ae77-22d7968b4c6e None None] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:47.470518 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea81c23-0d12-4637-9b20-053a39e79cbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:47.471189 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea81c23-0d12-4637-9b20-053a39e79cbf None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:47.471470 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea81c23-0d12-4637-9b20-053a39e79cbf None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:47.471743 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea81c23-0d12-4637-9b20-053a39e79cbf None admin] PATH_INFO: `/v3/services/compute` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:47.472425 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea81c23-0d12-4637-9b20-053a39e79cbf None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:47.473898 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea81c23-0d12-4637-9b20-053a39e79cbf None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:47.484249 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application [None req-aea81c23-0d12-4637-9b20-053a39e79cbf None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 26 14:39:47.484249 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:39:47.484249 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 14:39:47.484249 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 14:39:47.484249 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 14:39:47.484249 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 14:39:47.484249 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 14:39:47.484249 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 14:39:47.484249 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 26 14:39:47.484249 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Jul 26 14:39:47.484249 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 14:39:47.484249 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Jul 26 14:39:47.484249 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:39:47.484249 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:39:47.484249 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:39:47.484249 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:39:47.484249 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:39:47.486171 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:39:47.486171 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:39:47.486171 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:39:47.486171 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:39:47.486171 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:39:47.486171 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:39:47.486171 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 14:39:47.486171 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 14:39:47.486171 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 14:39:47.486171 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 14:39:47.486171 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:39:47.486171 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:39:47.486171 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:39:47.486171 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:39:47.486171 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:39:47.486171 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:39:47.488476 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:39:47.488476 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application with Lock( Jul 26 14:39:47.488476 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:39:47.488476 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:39:47.488476 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:39:47.488476 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:39:47.488476 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:39:47.488476 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:39:47.488476 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:39:47.488476 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:39:47.488476 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 14:39:47.488476 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 14:39:47.488476 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 26 14:39:47.488476 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Jul 26 14:39:47.491068 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 495/1013] 10.222.0.93 () {56 vars in 1111 bytes} [Tue Jul 26 14:39:47 2022] GET /identity/v3/services/compute => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 14:39:47.492066 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabb1cdf-0241-4ae9-95a7-dba895434b8e None None] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:47.626534 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:47.632702 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabb1cdf-0241-4ae9-95a7-dba895434b8e None None] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:47.684735 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2c8928-680a-4aed-a539-d447b4ef37ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:47.685402 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2c8928-680a-4aed-a539-d447b4ef37ea None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:47.688773 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2c8928-680a-4aed-a539-d447b4ef37ea None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:47.688773 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2c8928-680a-4aed-a539-d447b4ef37ea None admin] PATH_INFO: `/v3/services` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:47.688773 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2c8928-680a-4aed-a539-d447b4ef37ea None admin] RBAC: Adding query filter params (name=compute) {{(pid=87056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:39:47.688773 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2c8928-680a-4aed-a539-d447b4ef37ea None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:47.690281 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2c8928-680a-4aed-a539-d447b4ef37ea None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:47.698289 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 519/1014] 10.222.0.93 () {56 vars in 1112 bytes} [Tue Jul 26 14:39:47 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:39:47.704037 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea81c23-0d12-4637-9b20-053a39e79cbf None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:47.834476 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:47.845906 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea81c23-0d12-4637-9b20-053a39e79cbf None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:47.892982 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eceed7b-90ec-4a19-b588-aa4e7b434512 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:47.893712 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eceed7b-90ec-4a19-b588-aa4e7b434512 None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:47.894066 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eceed7b-90ec-4a19-b588-aa4e7b434512 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:47.895217 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eceed7b-90ec-4a19-b588-aa4e7b434512 None admin] PATH_INFO: `/v3/services` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:47.896115 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eceed7b-90ec-4a19-b588-aa4e7b434512 None admin] RBAC: Adding query filter params (type=compute) {{(pid=87055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:39:47.896611 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eceed7b-90ec-4a19-b588-aa4e7b434512 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:47.899002 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eceed7b-90ec-4a19-b588-aa4e7b434512 None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:47.910920 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 496/1015] 10.222.0.93 () {56 vars in 1112 bytes} [Tue Jul 26 14:39:47 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:39:47.912075 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2c8928-680a-4aed-a539-d447b4ef37ea None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:48.051959 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2c8928-680a-4aed-a539-d447b4ef37ea None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:48.102447 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aca68f1-9102-4da6-b180-7057bea97479 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:48.103169 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aca68f1-9102-4da6-b180-7057bea97479 None admin] REQUEST_METHOD: `POST` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:48.103534 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aca68f1-9102-4da6-b180-7057bea97479 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:48.103862 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aca68f1-9102-4da6-b180-7057bea97479 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:48.104763 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aca68f1-9102-4da6-b180-7057bea97479 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:48.106434 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aca68f1-9102-4da6-b180-7057bea97479 None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:48.141764 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6416040c-935f-4327-960f-05325e09416c None None] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:48.142049 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6416040c-935f-4327-960f-05325e09416c None None] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:48.145196 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6416040c-935f-4327-960f-05325e09416c None None] PATH_INFO: `/` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:48.145196 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 497/1016] 10.222.0.93 () {54 vars in 926 bytes} [Tue Jul 26 14:39:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 14:39:48.150957 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682f2fc1-34e9-425b-8b89-968e207f4be9 None None] REQUEST_METHOD: `POST` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:48.151663 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682f2fc1-34e9-425b-8b89-968e207f4be9 None None] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:48.151663 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682f2fc1-34e9-425b-8b89-968e207f4be9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:48.173400 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.auth.core [None req-682f2fc1-34e9-425b-8b89-968e207f4be9 None None] MFA Rules not processed for user `e5ef88cc058f425b882bcb87a1e1e75c`. Rule list: `[]` (Enabled: `True`). {{(pid=87055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:39:48.174657 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.fernet_utils [None req-682f2fc1-34e9-425b-8b89-968e207f4be9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:39:48.234627 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 520/1017] 10.222.0.93 () {60 vars in 1144 bytes} [Tue Jul 26 14:39:47 2022] POST /identity/v3/endpoints => generated 334 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 14:39:48.291832 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 498/1018] 10.222.0.93 () {58 vars in 1023 bytes} [Tue Jul 26 14:39:48 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 26 14:39:48.322838 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aca68f1-9102-4da6-b180-7057bea97479 None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:48.352956 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:48.434085 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7b601d-2870-4a3b-9ae7-1aaf29483ff7 None None] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:48.434567 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7b601d-2870-4a3b-9ae7-1aaf29483ff7 None None] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:48.436172 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7b601d-2870-4a3b-9ae7-1aaf29483ff7 None None] PATH_INFO: `/` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:48.439146 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 499/1019] 10.222.0.93 () {54 vars in 926 bytes} [Tue Jul 26 14:39:48 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:39:48.445404 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e18ad6-2a62-4a89-85c7-4b4e5b64512b None None] REQUEST_METHOD: `POST` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:48.450103 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e18ad6-2a62-4a89-85c7-4b4e5b64512b None None] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:48.450103 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e18ad6-2a62-4a89-85c7-4b4e5b64512b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:48.470588 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.auth.core [None req-24e18ad6-2a62-4a89-85c7-4b4e5b64512b None None] MFA Rules not processed for user `e5ef88cc058f425b882bcb87a1e1e75c`. Rule list: `[]` (Enabled: `True`). {{(pid=87055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:39:48.472135 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.fernet_utils [None req-24e18ad6-2a62-4a89-85c7-4b4e5b64512b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:39:48.484582 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aca68f1-9102-4da6-b180-7057bea97479 None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:48.541295 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddb45f8-c5b6-45a6-8103-57e24d249c96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:48.541987 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddb45f8-c5b6-45a6-8103-57e24d249c96 None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:48.542326 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddb45f8-c5b6-45a6-8103-57e24d249c96 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:48.542610 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddb45f8-c5b6-45a6-8103-57e24d249c96 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:48.543975 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddb45f8-c5b6-45a6-8103-57e24d249c96 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:48.546152 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddb45f8-c5b6-45a6-8103-57e24d249c96 None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:48.549006 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 521/1020] 10.222.0.93 () {56 vars in 1108 bytes} [Tue Jul 26 14:39:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:39:48.556603 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddb45f8-c5b6-45a6-8103-57e24d249c96 None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:48.588514 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 500/1021] 10.222.0.93 () {58 vars in 1023 bytes} [Tue Jul 26 14:39:48 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 14:39:48.626479 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e18ad6-2a62-4a89-85c7-4b4e5b64512b None None] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:48.644935 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:48.673633 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:48.699179 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddb45f8-c5b6-45a6-8103-57e24d249c96 None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:48.762172 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfb3f69-cd09-4fb8-a814-a09cef7d00d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:48.763041 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfb3f69-cd09-4fb8-a814-a09cef7d00d2 None admin] REQUEST_METHOD: `POST` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:48.763328 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfb3f69-cd09-4fb8-a814-a09cef7d00d2 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:48.763599 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfb3f69-cd09-4fb8-a814-a09cef7d00d2 None admin] PATH_INFO: `/v3/projects` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:48.764307 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfb3f69-cd09-4fb8-a814-a09cef7d00d2 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:48.765796 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfb3f69-cd09-4fb8-a814-a09cef7d00d2 None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:48.777389 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e18ad6-2a62-4a89-85c7-4b4e5b64512b None None] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:48.821270 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5366b38a-3d52-49a6-8703-ee0a0d2fba6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:48.821940 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5366b38a-3d52-49a6-8703-ee0a0d2fba6d None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:48.822228 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5366b38a-3d52-49a6-8703-ee0a0d2fba6d None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:48.822535 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5366b38a-3d52-49a6-8703-ee0a0d2fba6d None admin] PATH_INFO: `/v3/services/image` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:48.823180 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5366b38a-3d52-49a6-8703-ee0a0d2fba6d None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:48.824597 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5366b38a-3d52-49a6-8703-ee0a0d2fba6d None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:48.835332 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application [None req-5366b38a-3d52-49a6-8703-ee0a0d2fba6d None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 26 14:39:48.835332 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:39:48.835332 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 14:39:48.835332 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 14:39:48.835332 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 14:39:48.835332 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 14:39:48.835332 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 14:39:48.835332 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 14:39:48.835332 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 26 14:39:48.835332 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Jul 26 14:39:48.835332 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 14:39:48.835332 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Jul 26 14:39:48.835332 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:39:48.835332 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:39:48.835332 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:39:48.835332 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:39:48.835332 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:39:48.841781 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:39:48.841781 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:39:48.841781 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:39:48.841781 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:39:48.841781 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:39:48.841781 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:39:48.841781 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 14:39:48.841781 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 14:39:48.841781 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 14:39:48.841781 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 14:39:48.841781 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:39:48.841781 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:39:48.841781 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:39:48.841781 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:39:48.841781 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:39:48.841781 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:39:48.843432 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:39:48.843432 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application with Lock( Jul 26 14:39:48.843432 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:39:48.843432 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:39:48.843432 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:39:48.843432 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:39:48.843432 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:39:48.843432 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:39:48.843432 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:39:48.843432 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:39:48.843432 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 14:39:48.843432 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 14:39:48.843432 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 26 14:39:48.843432 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Jul 26 14:39:48.843432 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 501/1022] 10.222.0.93 () {56 vars in 1105 bytes} [Tue Jul 26 14:39:48 2022] GET /identity/v3/services/image => generated 86 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:39:48.844949 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5366b38a-3d52-49a6-8703-ee0a0d2fba6d None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:48.915642 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 522/1023] 10.222.0.93 () {60 vars in 1141 bytes} [Tue Jul 26 14:39:48 2022] POST /identity/v3/projects => generated 311 bytes in 360 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 14:39:48.967911 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:49.006356 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5366b38a-3d52-49a6-8703-ee0a0d2fba6d None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:49.070936 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976c120a-1dcf-42bd-bbbd-d4e90378a22e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:49.071746 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976c120a-1dcf-42bd-bbbd-d4e90378a22e None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:49.075106 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976c120a-1dcf-42bd-bbbd-d4e90378a22e None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:49.075710 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976c120a-1dcf-42bd-bbbd-d4e90378a22e None admin] PATH_INFO: `/v3/services` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:49.076319 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976c120a-1dcf-42bd-bbbd-d4e90378a22e None admin] RBAC: Adding query filter params (name=image) {{(pid=87055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:39:49.076635 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976c120a-1dcf-42bd-bbbd-d4e90378a22e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:49.078114 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976c120a-1dcf-42bd-bbbd-d4e90378a22e None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:49.085641 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 502/1024] 10.222.0.93 () {56 vars in 1108 bytes} [Tue Jul 26 14:39:48 2022] GET /identity/v3/services?name=image => generated 122 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:39:49.092356 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfb3f69-cd09-4fb8-a814-a09cef7d00d2 None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:49.247222 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfb3f69-cd09-4fb8-a814-a09cef7d00d2 None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:49.305828 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f35d59-0f03-4204-96a8-71b9f80da5bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:49.306905 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f35d59-0f03-4204-96a8-71b9f80da5bf None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:49.307379 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f35d59-0f03-4204-96a8-71b9f80da5bf None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:49.307795 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f35d59-0f03-4204-96a8-71b9f80da5bf None admin] PATH_INFO: `/v3/services` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:49.308689 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f35d59-0f03-4204-96a8-71b9f80da5bf None admin] RBAC: Adding query filter params (type=image) {{(pid=87056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:39:49.309197 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f35d59-0f03-4204-96a8-71b9f80da5bf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:49.310841 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f35d59-0f03-4204-96a8-71b9f80da5bf None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:49.319448 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 523/1025] 10.222.0.93 () {56 vars in 1108 bytes} [Tue Jul 26 14:39:49 2022] GET /identity/v3/services?type=image => generated 350 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:39:49.328910 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976c120a-1dcf-42bd-bbbd-d4e90378a22e None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:49.493291 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976c120a-1dcf-42bd-bbbd-d4e90378a22e None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:49.563697 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd68694-9281-46cf-a1cd-030e77d0b309 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:49.564824 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd68694-9281-46cf-a1cd-030e77d0b309 None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:49.565285 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd68694-9281-46cf-a1cd-030e77d0b309 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:49.565780 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd68694-9281-46cf-a1cd-030e77d0b309 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:49.567389 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd68694-9281-46cf-a1cd-030e77d0b309 None admin] RBAC: Adding query filter params (interface=public, service_id=fe94b7d63d6042209f6605b183c324f6, region_id=RegionOne) {{(pid=87055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:39:49.567920 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd68694-9281-46cf-a1cd-030e77d0b309 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:49.570431 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd68694-9281-46cf-a1cd-030e77d0b309 None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:49.586282 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 503/1026] 10.222.0.93 () {56 vars in 1251 bytes} [Tue Jul 26 14:39:49 2022] GET /identity/v3/endpoints?service_id=fe94b7d63d6042209f6605b183c324f6&interface=public®ion_id=RegionOne => generated 194 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:39:49.588768 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f35d59-0f03-4204-96a8-71b9f80da5bf None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:49.592841 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:49.740219 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f35d59-0f03-4204-96a8-71b9f80da5bf None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:49.783757 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d7dd0e-221b-4ab0-83d0-585f493d83eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:49.785016 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d7dd0e-221b-4ab0-83d0-585f493d83eb None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:49.785439 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d7dd0e-221b-4ab0-83d0-585f493d83eb None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:49.785842 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d7dd0e-221b-4ab0-83d0-585f493d83eb None admin] PATH_INFO: `/v3/services` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:49.786696 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d7dd0e-221b-4ab0-83d0-585f493d83eb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:49.788251 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d7dd0e-221b-4ab0-83d0-585f493d83eb None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:49.796614 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 524/1027] 10.222.0.93 () {56 vars in 1087 bytes} [Tue Jul 26 14:39:49 2022] GET /identity/v3/services => generated 1957 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 14:39:51.109461 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcf6af7-a3ad-4c35-a9a7-64b8656b8ba1 None None] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:51.110281 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcf6af7-a3ad-4c35-a9a7-64b8656b8ba1 None None] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:51.110281 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcf6af7-a3ad-4c35-a9a7-64b8656b8ba1 None None] PATH_INFO: `/` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:51.114314 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 504/1028] 10.222.0.93 () {54 vars in 926 bytes} [Tue Jul 26 14:39:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:39:51.120730 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba76d01f-9290-4d3d-b0e6-9006974f2d34 None None] REQUEST_METHOD: `POST` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:51.121277 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba76d01f-9290-4d3d-b0e6-9006974f2d34 None None] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:51.121708 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba76d01f-9290-4d3d-b0e6-9006974f2d34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:51.157156 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.auth.core [None req-ba76d01f-9290-4d3d-b0e6-9006974f2d34 None None] MFA Rules not processed for user `e5ef88cc058f425b882bcb87a1e1e75c`. Rule list: `[]` (Enabled: `True`). {{(pid=87056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:39:51.159349 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.fernet_utils [None req-ba76d01f-9290-4d3d-b0e6-9006974f2d34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:39:51.281825 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:51.298332 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 525/1029] 10.222.0.93 () {58 vars in 1023 bytes} [Tue Jul 26 14:39:51 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 14:39:51.337735 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcf6af7-a3ad-4c35-a9a7-64b8656b8ba1 None None] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:51.341094 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:51.463549 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faee2135-74ef-4013-8eb9-7754c38329d5 None None] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:51.463872 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faee2135-74ef-4013-8eb9-7754c38329d5 None None] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:51.464295 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faee2135-74ef-4013-8eb9-7754c38329d5 None None] PATH_INFO: `/` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:51.464684 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcf6af7-a3ad-4c35-a9a7-64b8656b8ba1 None None] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:51.470506 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 526/1030] 10.222.0.93 () {54 vars in 926 bytes} [Tue Jul 26 14:39:51 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 14:39:51.475021 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b737d95c-f22b-4f04-aaf4-3376a61fec86 None None] REQUEST_METHOD: `POST` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:51.475308 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b737d95c-f22b-4f04-aaf4-3376a61fec86 None None] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:51.475582 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b737d95c-f22b-4f04-aaf4-3376a61fec86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:51.500112 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.auth.core [None req-b737d95c-f22b-4f04-aaf4-3376a61fec86 None None] MFA Rules not processed for user `e5ef88cc058f425b882bcb87a1e1e75c`. Rule list: `[]` (Enabled: `True`). {{(pid=87056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:39:51.501347 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.fernet_utils [None req-b737d95c-f22b-4f04-aaf4-3376a61fec86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:39:51.521802 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e974df4-c86f-4dad-af66-58e1f5417229 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:51.522535 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e974df4-c86f-4dad-af66-58e1f5417229 None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:51.522823 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e974df4-c86f-4dad-af66-58e1f5417229 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:51.523102 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e974df4-c86f-4dad-af66-58e1f5417229 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:51.524542 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e974df4-c86f-4dad-af66-58e1f5417229 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:51.526055 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e974df4-c86f-4dad-af66-58e1f5417229 None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:51.528041 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 505/1031] 10.222.0.93 () {56 vars in 1108 bytes} [Tue Jul 26 14:39:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:39:51.537136 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e974df4-c86f-4dad-af66-58e1f5417229 None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:51.598298 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 527/1032] 10.222.0.93 () {58 vars in 1023 bytes} [Tue Jul 26 14:39:51 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 26 14:39:51.638458 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b737d95c-f22b-4f04-aaf4-3376a61fec86 None None] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:51.648467 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:51.715042 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e974df4-c86f-4dad-af66-58e1f5417229 None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:51.781789 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b737d95c-f22b-4f04-aaf4-3376a61fec86 None None] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:51.787050 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c456af99-c8d0-47c5-a9fc-5a6c56f22fc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:51.788174 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c456af99-c8d0-47c5-a9fc-5a6c56f22fc8 None admin] REQUEST_METHOD: `POST` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:51.788668 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c456af99-c8d0-47c5-a9fc-5a6c56f22fc8 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:51.789105 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c456af99-c8d0-47c5-a9fc-5a6c56f22fc8 None admin] PATH_INFO: `/v3/users` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:51.790453 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c456af99-c8d0-47c5-a9fc-5a6c56f22fc8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:51.793183 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c456af99-c8d0-47c5-a9fc-5a6c56f22fc8 None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:51.828404 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:51.844545 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca4b253-40e4-4e8c-9156-981fee54bf15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:51.845628 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca4b253-40e4-4e8c-9156-981fee54bf15 None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:51.846135 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca4b253-40e4-4e8c-9156-981fee54bf15 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:51.848611 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca4b253-40e4-4e8c-9156-981fee54bf15 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:51.867339 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca4b253-40e4-4e8c-9156-981fee54bf15 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 14:39:51.877888 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application [None req-5ca4b253-40e4-4e8c-9156-981fee54bf15 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 26 14:39:51.877888 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:39:51.877888 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:39:51.877888 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:39:51.877888 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:39:51.877888 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:39:51.877888 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:39:51.877888 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:39:51.877888 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:39:51.877888 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:39:51.877888 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:39:51.877888 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:39:51.877888 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 14:39:51.877888 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 14:39:51.877888 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 14:39:51.877888 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 14:39:51.878976 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 14:39:51.878976 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 14:39:51.878976 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 14:39:51.878976 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 14:39:51.878976 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:39:51.878976 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:39:51.878976 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:39:51.878976 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:39:51.878976 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:39:51.878976 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:39:51.878976 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:39:51.878976 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application with Lock( Jul 26 14:39:51.878976 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:39:51.878976 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:39:51.878976 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:39:51.878976 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:39:51.879954 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:39:51.879954 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:39:51.879954 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:39:51.879954 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:39:51.879954 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 14:39:51.879954 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 14:39:51.879954 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 14:39:51.879954 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 14:39:51.879954 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 14:39:51.879954 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 14:39:51.879954 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 26 14:39:51.879954 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Jul 26 14:39:51.882434 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 528/1033] 10.222.0.93 () {56 vars in 1120 bytes} [Tue Jul 26 14:39:51 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 14:39:51.889291 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca4b253-40e4-4e8c-9156-981fee54bf15 None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:51.944139 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 506/1034] 10.222.0.93 () {60 vars in 1132 bytes} [Tue Jul 26 14:39:51 2022] POST /identity/v3/users => generated 285 bytes in 408 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 14:39:52.025401 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca4b253-40e4-4e8c-9156-981fee54bf15 None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:52.069943 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af19d69-7763-4d83-a93e-1b67e74e8e68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:52.070638 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af19d69-7763-4d83-a93e-1b67e74e8e68 None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:52.070923 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af19d69-7763-4d83-a93e-1b67e74e8e68 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:52.071217 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af19d69-7763-4d83-a93e-1b67e74e8e68 None admin] PATH_INFO: `/v3/roles` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:52.071979 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af19d69-7763-4d83-a93e-1b67e74e8e68 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=87056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:39:52.072289 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af19d69-7763-4d83-a93e-1b67e74e8e68 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:52.073784 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af19d69-7763-4d83-a93e-1b67e74e8e68 None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:52.089441 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 529/1035] 10.222.0.93 () {56 vars in 1115 bytes} [Tue Jul 26 14:39:51 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:39:52.090876 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c456af99-c8d0-47c5-a9fc-5a6c56f22fc8 None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:52.145862 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc8b269-1314-477d-9ecc-499c808b528a None None] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:52.146974 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc8b269-1314-477d-9ecc-499c808b528a None None] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:52.147209 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc8b269-1314-477d-9ecc-499c808b528a None None] PATH_INFO: `/` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:52.148649 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 530/1036] 10.222.0.93 () {54 vars in 926 bytes} [Tue Jul 26 14:39:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:39:52.154778 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ab73ad-63b8-4319-942e-2200710a7b69 None None] REQUEST_METHOD: `POST` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:52.155125 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ab73ad-63b8-4319-942e-2200710a7b69 None None] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:52.155349 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ab73ad-63b8-4319-942e-2200710a7b69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:52.175504 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.auth.core [None req-57ab73ad-63b8-4319-942e-2200710a7b69 None None] MFA Rules not processed for user `e5ef88cc058f425b882bcb87a1e1e75c`. Rule list: `[]` (Enabled: `True`). {{(pid=87056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:39:52.176932 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.fernet_utils [None req-57ab73ad-63b8-4319-942e-2200710a7b69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:39:52.233616 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c456af99-c8d0-47c5-a9fc-5a6c56f22fc8 None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:52.243685 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:52.273705 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:52.283488 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 531/1037] 10.222.0.93 () {58 vars in 1023 bytes} [Tue Jul 26 14:39:52 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 26 14:39:52.284956 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8de6e9d-e554-43cd-88a4-b51f04be737e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:52.285990 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8de6e9d-e554-43cd-88a4-b51f04be737e None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:52.286450 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8de6e9d-e554-43cd-88a4-b51f04be737e None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:52.286611 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8de6e9d-e554-43cd-88a4-b51f04be737e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:52.299130 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8de6e9d-e554-43cd-88a4-b51f04be737e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:52.301409 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8de6e9d-e554-43cd-88a4-b51f04be737e None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:52.313737 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ab73ad-63b8-4319-942e-2200710a7b69 None None] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:52.318600 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application [None req-f8de6e9d-e554-43cd-88a4-b51f04be737e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:39:52.318600 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:39:52.318600 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:39:52.318600 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:39:52.318600 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:39:52.318600 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:39:52.318600 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:39:52.318600 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:39:52.318600 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:39:52.318600 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:39:52.318600 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:39:52.318600 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:39:52.318600 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 14:39:52.318600 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 14:39:52.318600 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 14:39:52.324533 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 14:39:52.324533 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:39:52.324533 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:39:52.324533 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:39:52.324533 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:39:52.324533 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:39:52.324533 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:39:52.324533 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:39:52.324533 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application with Lock( Jul 26 14:39:52.324533 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:39:52.324533 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:39:52.324533 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:39:52.324533 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:39:52.324533 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:39:52.324533 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:39:52.324533 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:39:52.324533 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:39:52.325675 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 14:39:52.325675 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 14:39:52.325675 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:39:52.325675 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Jul 26 14:39:52.325675 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 507/1038] 10.222.0.93 () {56 vars in 1108 bytes} [Tue Jul 26 14:39:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:39:52.326414 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8de6e9d-e554-43cd-88a4-b51f04be737e None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:52.451503 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ab73ad-63b8-4319-942e-2200710a7b69 None None] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:52.465636 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8de6e9d-e554-43cd-88a4-b51f04be737e None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:52.500370 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e04f1b-2a29-44ca-8f73-28de1eb3d92f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:52.501233 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e04f1b-2a29-44ca-8f73-28de1eb3d92f None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:52.501452 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e04f1b-2a29-44ca-8f73-28de1eb3d92f None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:52.501617 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e04f1b-2a29-44ca-8f73-28de1eb3d92f None admin] PATH_INFO: `/v3/services/image` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:52.502237 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e04f1b-2a29-44ca-8f73-28de1eb3d92f None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:52.504375 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e04f1b-2a29-44ca-8f73-28de1eb3d92f None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:52.510965 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fea8bc0-b81a-4839-98cb-9cd0a84de8da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:52.511603 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fea8bc0-b81a-4839-98cb-9cd0a84de8da None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:52.511889 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fea8bc0-b81a-4839-98cb-9cd0a84de8da None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:52.512165 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fea8bc0-b81a-4839-98cb-9cd0a84de8da None admin] PATH_INFO: `/v3/domains` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:52.512877 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fea8bc0-b81a-4839-98cb-9cd0a84de8da None admin] RBAC: Adding query filter params (name=Default) {{(pid=87055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:39:52.513173 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fea8bc0-b81a-4839-98cb-9cd0a84de8da None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:52.514580 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application [None req-47e04f1b-2a29-44ca-8f73-28de1eb3d92f None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 26 14:39:52.514580 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:39:52.514580 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 14:39:52.514580 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 14:39:52.514580 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 14:39:52.514580 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 14:39:52.514580 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 14:39:52.514580 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 14:39:52.514580 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 26 14:39:52.514580 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Jul 26 14:39:52.514580 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 14:39:52.514580 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Jul 26 14:39:52.514580 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:39:52.514580 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:39:52.514580 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:39:52.514580 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:39:52.514580 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:39:52.515800 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:39:52.515800 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:39:52.515800 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:39:52.515800 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:39:52.515800 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:39:52.515800 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:39:52.515800 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 14:39:52.515800 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 14:39:52.515800 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 14:39:52.515800 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 14:39:52.515800 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:39:52.515800 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:39:52.515800 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:39:52.515800 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:39:52.515800 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:39:52.515800 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:39:52.517197 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:39:52.517197 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application with Lock( Jul 26 14:39:52.517197 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:39:52.517197 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:39:52.517197 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:39:52.517197 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:39:52.517197 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:39:52.517197 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:39:52.517197 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:39:52.517197 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:39:52.517197 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 14:39:52.517197 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 14:39:52.517197 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 26 14:39:52.517197 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Jul 26 14:39:52.521210 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fea8bc0-b81a-4839-98cb-9cd0a84de8da None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:52.521815 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 532/1039] 10.222.0.93 () {56 vars in 1105 bytes} [Tue Jul 26 14:39:52 2022] GET /identity/v3/services/image => generated 86 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 14:39:52.522829 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e04f1b-2a29-44ca-8f73-28de1eb3d92f None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:52.535813 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 508/1040] 10.222.0.93 () {56 vars in 1109 bytes} [Tue Jul 26 14:39:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:39:52.541622 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fea8bc0-b81a-4839-98cb-9cd0a84de8da None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:52.577679 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:52.598763 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:52.658216 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e04f1b-2a29-44ca-8f73-28de1eb3d92f None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:52.685316 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fea8bc0-b81a-4839-98cb-9cd0a84de8da None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:52.700006 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aec759c-e11a-4327-afff-964da74fc0d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:52.700646 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aec759c-e11a-4327-afff-964da74fc0d2 None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:52.700929 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aec759c-e11a-4327-afff-964da74fc0d2 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:52.701204 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aec759c-e11a-4327-afff-964da74fc0d2 None admin] PATH_INFO: `/v3/services` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:52.701898 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aec759c-e11a-4327-afff-964da74fc0d2 None admin] RBAC: Adding query filter params (name=image) {{(pid=87056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:39:52.702208 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aec759c-e11a-4327-afff-964da74fc0d2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:52.703648 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aec759c-e11a-4327-afff-964da74fc0d2 None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:52.715596 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 533/1041] 10.222.0.93 () {56 vars in 1108 bytes} [Tue Jul 26 14:39:52 2022] GET /identity/v3/services?name=image => generated 122 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:39:52.716857 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aec759c-e11a-4327-afff-964da74fc0d2 None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:52.759701 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dee79b7-fbcd-4a24-94ac-d5b9f1d9c40c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:52.760805 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dee79b7-fbcd-4a24-94ac-d5b9f1d9c40c None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:52.761290 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dee79b7-fbcd-4a24-94ac-d5b9f1d9c40c None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:52.761782 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dee79b7-fbcd-4a24-94ac-d5b9f1d9c40c None admin] PATH_INFO: `/v3/users/nova` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:52.776139 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dee79b7-fbcd-4a24-94ac-d5b9f1d9c40c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:52.778779 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dee79b7-fbcd-4a24-94ac-d5b9f1d9c40c None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:52.805063 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application [None req-1dee79b7-fbcd-4a24-94ac-d5b9f1d9c40c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 26 14:39:52.805063 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:39:52.805063 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:39:52.805063 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:39:52.805063 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:39:52.805063 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:39:52.805063 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:39:52.805063 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:39:52.805063 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:39:52.805063 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:39:52.805063 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:39:52.805063 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:39:52.805063 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 14:39:52.805063 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 14:39:52.805063 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 14:39:52.805063 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 14:39:52.806069 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:39:52.806069 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:39:52.806069 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 14:39:52.806069 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 14:39:52.806069 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 14:39:52.806069 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 14:39:52.806069 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:39:52.806069 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:39:52.806069 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:39:52.806069 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:39:52.806069 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:39:52.806069 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application with Lock( Jul 26 14:39:52.806069 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:39:52.806069 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:39:52.806069 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:39:52.806069 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:39:52.806069 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:39:52.806069 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:39:52.807088 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:39:52.807088 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:39:52.807088 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 14:39:52.807088 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 14:39:52.807088 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 14:39:52.807088 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 14:39:52.807088 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 14:39:52.807088 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 14:39:52.807088 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 26 14:39:52.807088 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Jul 26 14:39:52.807730 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 509/1042] 10.222.0.93 () {56 vars in 1093 bytes} [Tue Jul 26 14:39:52 2022] GET /identity/v3/users/nova => generated 82 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:39:52.813066 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dee79b7-fbcd-4a24-94ac-d5b9f1d9c40c None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:52.863514 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aec759c-e11a-4327-afff-964da74fc0d2 None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:52.871859 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:52.905294 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02702ca-d998-48da-9e38-4642419cccfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:52.905940 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02702ca-d998-48da-9e38-4642419cccfd None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:52.906488 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02702ca-d998-48da-9e38-4642419cccfd None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:52.906813 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02702ca-d998-48da-9e38-4642419cccfd None admin] PATH_INFO: `/v3/services` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:52.907540 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02702ca-d998-48da-9e38-4642419cccfd None admin] RBAC: Adding query filter params (type=image) {{(pid=87056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:39:52.907853 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02702ca-d998-48da-9e38-4642419cccfd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:52.909896 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02702ca-d998-48da-9e38-4642419cccfd None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:52.918042 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 534/1043] 10.222.0.93 () {56 vars in 1108 bytes} [Tue Jul 26 14:39:52 2022] GET /identity/v3/services?type=image => generated 350 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:39:52.924328 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02702ca-d998-48da-9e38-4642419cccfd None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:52.953319 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:52.958210 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dee79b7-fbcd-4a24-94ac-d5b9f1d9c40c None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:53.007862 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd33937d-8a7e-47a1-8f5a-0bc7619f633e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:53.008512 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd33937d-8a7e-47a1-8f5a-0bc7619f633e None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:53.008795 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd33937d-8a7e-47a1-8f5a-0bc7619f633e None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:53.009076 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd33937d-8a7e-47a1-8f5a-0bc7619f633e None admin] PATH_INFO: `/v3/users` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:53.009924 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd33937d-8a7e-47a1-8f5a-0bc7619f633e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:39:53.010462 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd33937d-8a7e-47a1-8f5a-0bc7619f633e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:53.011765 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd33937d-8a7e-47a1-8f5a-0bc7619f633e None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:53.033946 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 510/1044] 10.222.0.93 () {56 vars in 1133 bytes} [Tue Jul 26 14:39:52 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:39:53.041071 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd33937d-8a7e-47a1-8f5a-0bc7619f633e None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:53.076796 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02702ca-d998-48da-9e38-4642419cccfd None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:53.130735 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f53f8a2-344c-4947-9e5e-3e256bb2fea8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:53.131729 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f53f8a2-344c-4947-9e5e-3e256bb2fea8 None admin] REQUEST_METHOD: `POST` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:53.132170 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f53f8a2-344c-4947-9e5e-3e256bb2fea8 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:53.132623 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f53f8a2-344c-4947-9e5e-3e256bb2fea8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:53.133656 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f53f8a2-344c-4947-9e5e-3e256bb2fea8 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:53.136144 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f53f8a2-344c-4947-9e5e-3e256bb2fea8 None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:53.185500 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd33937d-8a7e-47a1-8f5a-0bc7619f633e None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:53.227868 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b10cb6b-ad33-4f2d-9df5-a12c35ecc660 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:53.228506 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b10cb6b-ad33-4f2d-9df5-a12c35ecc660 None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:53.228817 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b10cb6b-ad33-4f2d-9df5-a12c35ecc660 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:53.229092 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b10cb6b-ad33-4f2d-9df5-a12c35ecc660 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:53.265300 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:53.286278 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 535/1045] 10.222.0.93 () {60 vars in 1144 bytes} [Tue Jul 26 14:39:52 2022] POST /identity/v3/endpoints => generated 327 bytes in 354 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 14:39:53.333050 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b10cb6b-ad33-4f2d-9df5-a12c35ecc660 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:53.334619 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b10cb6b-ad33-4f2d-9df5-a12c35ecc660 None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:53.505263 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 511/1046] 10.222.0.93 () {58 vars in 1282 bytes} [Tue Jul 26 14:39:53 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 465 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 26 14:39:53.515402 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f53f8a2-344c-4947-9e5e-3e256bb2fea8 None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:53.569028 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:53.712519 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f53f8a2-344c-4947-9e5e-3e256bb2fea8 None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:53.766421 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42483a9e-410d-4aab-95fe-9583cd92f2ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:53.767207 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42483a9e-410d-4aab-95fe-9583cd92f2ce None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:53.767564 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42483a9e-410d-4aab-95fe-9583cd92f2ce None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:53.767849 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42483a9e-410d-4aab-95fe-9583cd92f2ce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:53.782850 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42483a9e-410d-4aab-95fe-9583cd92f2ce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:53.784938 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42483a9e-410d-4aab-95fe-9583cd92f2ce None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:53.811730 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application [None req-42483a9e-410d-4aab-95fe-9583cd92f2ce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:39:53.811730 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:39:53.811730 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:39:53.811730 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:39:53.811730 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:39:53.811730 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:39:53.811730 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:39:53.811730 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:39:53.811730 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:39:53.811730 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:39:53.811730 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:39:53.811730 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:39:53.811730 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 14:39:53.811730 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 14:39:53.811730 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 14:39:53.813555 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 14:39:53.813555 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:39:53.813555 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:39:53.813555 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:39:53.813555 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:39:53.813555 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:39:53.813555 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:39:53.813555 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:39:53.813555 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application with Lock( Jul 26 14:39:53.813555 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:39:53.813555 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:39:53.813555 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:39:53.813555 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:39:53.813555 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:39:53.813555 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:39:53.813555 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:39:53.813555 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:39:53.816815 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 14:39:53.816815 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 14:39:53.816815 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:39:53.816815 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Jul 26 14:39:53.816815 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 536/1047] 10.222.0.93 () {56 vars in 1108 bytes} [Tue Jul 26 14:39:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:39:53.822924 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b10cb6b-ad33-4f2d-9df5-a12c35ecc660 None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:53.934141 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:54.027371 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b10cb6b-ad33-4f2d-9df5-a12c35ecc660 None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:54.100290 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a324820a-0308-463e-a17b-e7b39f468851 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:54.101378 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a324820a-0308-463e-a17b-e7b39f468851 None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:54.101867 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a324820a-0308-463e-a17b-e7b39f468851 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:54.102388 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a324820a-0308-463e-a17b-e7b39f468851 None admin] PATH_INFO: `/v3/domains` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:54.103695 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a324820a-0308-463e-a17b-e7b39f468851 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:39:54.104213 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a324820a-0308-463e-a17b-e7b39f468851 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:54.106855 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a324820a-0308-463e-a17b-e7b39f468851 None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:54.138298 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 512/1048] 10.222.0.93 () {56 vars in 1109 bytes} [Tue Jul 26 14:39:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:39:54.142914 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42483a9e-410d-4aab-95fe-9583cd92f2ce None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:54.297943 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:54.351694 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42483a9e-410d-4aab-95fe-9583cd92f2ce None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:54.422461 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2012c399-b9c7-49b5-bcfb-d7d780a8e62d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:54.423589 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2012c399-b9c7-49b5-bcfb-d7d780a8e62d None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:54.424083 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2012c399-b9c7-49b5-bcfb-d7d780a8e62d None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:54.424590 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2012c399-b9c7-49b5-bcfb-d7d780a8e62d None admin] PATH_INFO: `/v3/projects/service` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:54.439031 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2012c399-b9c7-49b5-bcfb-d7d780a8e62d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:54.442430 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2012c399-b9c7-49b5-bcfb-d7d780a8e62d None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:54.465575 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application [None req-2012c399-b9c7-49b5-bcfb-d7d780a8e62d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 14:39:54.465575 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:39:54.465575 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:39:54.465575 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:39:54.465575 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:39:54.465575 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:39:54.465575 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:39:54.465575 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:39:54.465575 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:39:54.465575 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:39:54.465575 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:39:54.465575 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:39:54.465575 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 14:39:54.465575 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 14:39:54.465575 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 14:39:54.467657 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 14:39:54.467657 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:39:54.467657 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:39:54.467657 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:39:54.467657 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:39:54.467657 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:39:54.467657 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:39:54.467657 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:39:54.467657 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application with Lock( Jul 26 14:39:54.467657 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:39:54.467657 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:39:54.467657 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:39:54.467657 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:39:54.467657 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:39:54.467657 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:39:54.467657 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:39:54.467657 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:39:54.469467 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 14:39:54.469467 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 14:39:54.469467 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 14:39:54.469467 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 14:39:54.469467 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 14:39:54.469467 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 14:39:54.469467 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 14:39:54.469467 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Jul 26 14:39:54.469467 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 537/1049] 10.222.0.93 () {56 vars in 1111 bytes} [Tue Jul 26 14:39:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 326 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:39:54.479517 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8870bd2-11c5-4748-9743-dc27397ea6d8 None None] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:54.479517 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8870bd2-11c5-4748-9743-dc27397ea6d8 None None] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:54.479517 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8870bd2-11c5-4748-9743-dc27397ea6d8 None None] PATH_INFO: `/` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:54.479517 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 513/1050] 10.222.0.93 () {54 vars in 926 bytes} [Tue Jul 26 14:39:54 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:39:54.483203 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2012c399-b9c7-49b5-bcfb-d7d780a8e62d None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:54.490281 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f78d4b-c388-4cf8-aada-969407113e5a None None] REQUEST_METHOD: `POST` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:54.490836 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f78d4b-c388-4cf8-aada-969407113e5a None None] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:54.491325 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f78d4b-c388-4cf8-aada-969407113e5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:54.525004 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.auth.core [None req-d2f78d4b-c388-4cf8-aada-969407113e5a None None] MFA Rules not processed for user `e5ef88cc058f425b882bcb87a1e1e75c`. Rule list: `[]` (Enabled: `True`). {{(pid=87055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:39:54.527145 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.fernet_utils [None req-d2f78d4b-c388-4cf8-aada-969407113e5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:39:54.629205 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 514/1051] 10.222.0.93 () {58 vars in 1023 bytes} [Tue Jul 26 14:39:54 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 26 14:39:54.648075 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2012c399-b9c7-49b5-bcfb-d7d780a8e62d None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:54.670333 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f78d4b-c388-4cf8-aada-969407113e5a None None] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:54.714289 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4810a834-038a-4d58-8d4d-b718b927d997 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:54.715349 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4810a834-038a-4d58-8d4d-b718b927d997 None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:54.717170 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4810a834-038a-4d58-8d4d-b718b927d997 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:54.717722 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4810a834-038a-4d58-8d4d-b718b927d997 None admin] PATH_INFO: `/v3/projects` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:54.719406 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4810a834-038a-4d58-8d4d-b718b927d997 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:39:54.719991 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4810a834-038a-4d58-8d4d-b718b927d997 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:54.722931 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4810a834-038a-4d58-8d4d-b718b927d997 None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:54.725975 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:54.747075 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 538/1052] 10.222.0.93 () {56 vars in 1148 bytes} [Tue Jul 26 14:39:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:39:54.756459 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:54.757867 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4810a834-038a-4d58-8d4d-b718b927d997 None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:54.843302 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f78d4b-c388-4cf8-aada-969407113e5a None None] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:54.916069 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73cb2a6-817a-4e74-a38d-531270cfeba1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:54.916949 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73cb2a6-817a-4e74-a38d-531270cfeba1 None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:54.917387 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73cb2a6-817a-4e74-a38d-531270cfeba1 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:54.917817 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73cb2a6-817a-4e74-a38d-531270cfeba1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:54.939640 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73cb2a6-817a-4e74-a38d-531270cfeba1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 14:39:54.950054 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application [None req-d73cb2a6-817a-4e74-a38d-531270cfeba1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 14:39:54.950054 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:39:54.950054 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:39:54.950054 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:39:54.950054 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:39:54.950054 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:39:54.950054 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:39:54.950054 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:39:54.950054 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:39:54.950054 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:39:54.950054 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:39:54.950054 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:39:54.950054 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 14:39:54.950054 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 14:39:54.950054 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 14:39:54.950054 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 14:39:54.951121 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 14:39:54.951121 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 14:39:54.951121 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 14:39:54.951121 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 14:39:54.951121 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:39:54.951121 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:39:54.951121 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:39:54.951121 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:39:54.951121 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:39:54.951121 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:39:54.951121 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:39:54.951121 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application with Lock( Jul 26 14:39:54.951121 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:39:54.951121 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:39:54.951121 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:39:54.951121 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:39:54.951968 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:39:54.951968 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:39:54.951968 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:39:54.951968 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:39:54.951968 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 14:39:54.951968 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 14:39:54.951968 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 14:39:54.951968 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 14:39:54.951968 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 14:39:54.951968 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 14:39:54.951968 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 14:39:54.951968 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Jul 26 14:39:54.953508 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 515/1053] 10.222.0.93 () {56 vars in 1096 bytes} [Tue Jul 26 14:39:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 14:39:54.962194 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73cb2a6-817a-4e74-a38d-531270cfeba1 None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:54.973092 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4810a834-038a-4d58-8d4d-b718b927d997 None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:55.056310 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35636ed-5096-4364-839c-ddcce079768f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:55.057345 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35636ed-5096-4364-839c-ddcce079768f None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:55.057833 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35636ed-5096-4364-839c-ddcce079768f None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:55.058318 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35636ed-5096-4364-839c-ddcce079768f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:55.059666 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35636ed-5096-4364-839c-ddcce079768f None admin] RBAC: Adding query filter params (role.id=fb41e639164e46ba82e91c6a63dd4898, scope.project.id=c422a2290a14424da20e2841cbc1741d, user.id=2e86fe36c9bf49a481c9f15ac7571b88) {{(pid=87056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:39:55.060118 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35636ed-5096-4364-839c-ddcce079768f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:55.061738 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35636ed-5096-4364-839c-ddcce079768f None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:55.070626 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 539/1054] 10.222.0.93 () {56 vars in 1374 bytes} [Tue Jul 26 14:39:54 2022] GET /identity/v3/role_assignments?user.id=2e86fe36c9bf49a481c9f15ac7571b88&scope.project.id=c422a2290a14424da20e2841cbc1741d&role.id=fb41e639164e46ba82e91c6a63dd4898 => generated 259 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:39:55.161719 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73cb2a6-817a-4e74-a38d-531270cfeba1 None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:55.177476 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:55.236185 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f59193f-813b-47d9-850d-debf7f8549af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:55.237287 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f59193f-813b-47d9-850d-debf7f8549af None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:55.238528 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f59193f-813b-47d9-850d-debf7f8549af None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:55.239034 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f59193f-813b-47d9-850d-debf7f8549af None admin] PATH_INFO: `/v3/roles` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:55.240441 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f59193f-813b-47d9-850d-debf7f8549af None admin] RBAC: Adding query filter params (name=admin) {{(pid=87055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:39:55.240981 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f59193f-813b-47d9-850d-debf7f8549af None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:55.243683 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f59193f-813b-47d9-850d-debf7f8549af None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:55.263019 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 516/1055] 10.222.0.93 () {56 vars in 1099 bytes} [Tue Jul 26 14:39:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:39:55.275871 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35636ed-5096-4364-839c-ddcce079768f None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:55.412566 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:55.492560 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35636ed-5096-4364-839c-ddcce079768f None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:55.558340 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65851b31-beeb-4e5e-8b1f-deddf261b1bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:55.559502 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65851b31-beeb-4e5e-8b1f-deddf261b1bd None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:55.559979 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65851b31-beeb-4e5e-8b1f-deddf261b1bd None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:55.560475 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65851b31-beeb-4e5e-8b1f-deddf261b1bd None admin] PATH_INFO: `/v3/users/7266dd64c01e47959d0e1ab68628555b` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:55.587281 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65851b31-beeb-4e5e-8b1f-deddf261b1bd None admin] RBAC: Authorizing `identity:get_user(user_id=7266dd64c01e47959d0e1ab68628555b)` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:55.589953 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65851b31-beeb-4e5e-8b1f-deddf261b1bd None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:55.598452 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 540/1056] 10.222.0.93 () {56 vars in 1177 bytes} [Tue Jul 26 14:39:55 2022] GET /identity/v3/users/7266dd64c01e47959d0e1ab68628555b => generated 285 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:39:55.600970 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f59193f-813b-47d9-850d-debf7f8549af None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:55.803257 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f59193f-813b-47d9-850d-debf7f8549af None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:55.870409 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7cf649-9a60-4fb7-9280-b025370060f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:55.871994 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7cf649-9a60-4fb7-9280-b025370060f4 None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:55.872817 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7cf649-9a60-4fb7-9280-b025370060f4 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:55.873599 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7cf649-9a60-4fb7-9280-b025370060f4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:55.901325 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6dc91d-dd3f-4fa8-a45c-9ec671cea536 None None] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:55.901671 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6dc91d-dd3f-4fa8-a45c-9ec671cea536 None None] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:55.901895 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6dc91d-dd3f-4fa8-a45c-9ec671cea536 None None] PATH_INFO: `/` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:55.903528 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 541/1057] 10.222.0.93 () {54 vars in 926 bytes} [Tue Jul 26 14:39:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 14:39:55.910232 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800cef5e-5331-4cf1-8bea-9dfb855d36b9 None None] REQUEST_METHOD: `POST` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:55.910571 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800cef5e-5331-4cf1-8bea-9dfb855d36b9 None None] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:55.910830 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800cef5e-5331-4cf1-8bea-9dfb855d36b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:55.933090 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.auth.core [None req-800cef5e-5331-4cf1-8bea-9dfb855d36b9 None None] MFA Rules not processed for user `e5ef88cc058f425b882bcb87a1e1e75c`. Rule list: `[]` (Enabled: `True`). {{(pid=87056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:39:55.934453 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.fernet_utils [None req-800cef5e-5331-4cf1-8bea-9dfb855d36b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:39:55.941635 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:55.988644 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7cf649-9a60-4fb7-9280-b025370060f4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:55.990226 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7cf649-9a60-4fb7-9280-b025370060f4 None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:56.020402 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 542/1058] 10.222.0.93 () {58 vars in 1023 bytes} [Tue Jul 26 14:39:55 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 26 14:39:56.043808 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800cef5e-5331-4cf1-8bea-9dfb855d36b9 None None] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:56.104051 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:56.143339 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 517/1059] 10.222.0.93 () {58 vars in 1282 bytes} [Tue Jul 26 14:39:55 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 543 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 26 14:39:56.153727 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7cf649-9a60-4fb7-9280-b025370060f4 None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:56.174604 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800cef5e-5331-4cf1-8bea-9dfb855d36b9 None None] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:56.238171 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b45488-9438-4f1e-8c6d-e9e4148af528 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:56.239237 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b45488-9438-4f1e-8c6d-e9e4148af528 None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:56.239237 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b45488-9438-4f1e-8c6d-e9e4148af528 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:56.239437 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b45488-9438-4f1e-8c6d-e9e4148af528 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:56.259023 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:56.300883 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7cf649-9a60-4fb7-9280-b025370060f4 None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:56.332005 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b45488-9438-4f1e-8c6d-e9e4148af528 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:56.333524 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b45488-9438-4f1e-8c6d-e9e4148af528 None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:56.344324 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f13805-ff7d-49e6-8d88-fc45b6652e2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:56.344993 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f13805-ff7d-49e6-8d88-fc45b6652e2e None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:56.345272 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f13805-ff7d-49e6-8d88-fc45b6652e2e None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:56.345544 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f13805-ff7d-49e6-8d88-fc45b6652e2e None admin] PATH_INFO: `/v3/projects/37b0bc0010c04c6bbdd5500d8e4b8f07` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:56.347695 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f13805-ff7d-49e6-8d88-fc45b6652e2e None admin] RBAC: Authorizing `identity:get_project(project_id=37b0bc0010c04c6bbdd5500d8e4b8f07)` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:56.349307 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f13805-ff7d-49e6-8d88-fc45b6652e2e None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:56.351505 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 518/1060] 10.222.0.93 () {56 vars in 1186 bytes} [Tue Jul 26 14:39:56 2022] GET /identity/v3/projects/37b0bc0010c04c6bbdd5500d8e4b8f07 => generated 311 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:39:56.357856 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f13805-ff7d-49e6-8d88-fc45b6652e2e None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:56.399449 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:56.472920 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 543/1061] 10.222.0.93 () {58 vars in 1282 bytes} [Tue Jul 26 14:39:56 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 26 14:39:56.479426 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b45488-9438-4f1e-8c6d-e9e4148af528 None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:56.500743 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f13805-ff7d-49e6-8d88-fc45b6652e2e None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:56.548601 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf94b45-6ab5-4b82-93af-7642a292d3f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:56.549237 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf94b45-6ab5-4b82-93af-7642a292d3f6 None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:56.550207 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf94b45-6ab5-4b82-93af-7642a292d3f6 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:56.550551 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf94b45-6ab5-4b82-93af-7642a292d3f6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:56.551336 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf94b45-6ab5-4b82-93af-7642a292d3f6 None admin] RBAC: Adding query filter params (role.id=94e105ff8ee4486abd501415cc05ba38, scope.project.id=37b0bc0010c04c6bbdd5500d8e4b8f07, user.id=7266dd64c01e47959d0e1ab68628555b) {{(pid=87055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:39:56.551650 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf94b45-6ab5-4b82-93af-7642a292d3f6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:56.553114 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf94b45-6ab5-4b82-93af-7642a292d3f6 None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:56.556714 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:56.561975 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 519/1062] 10.222.0.93 () {56 vars in 1374 bytes} [Tue Jul 26 14:39:56 2022] GET /identity/v3/role_assignments?user.id=7266dd64c01e47959d0e1ab68628555b&scope.project.id=37b0bc0010c04c6bbdd5500d8e4b8f07&role.id=94e105ff8ee4486abd501415cc05ba38 => generated 259 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:39:56.620862 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b45488-9438-4f1e-8c6d-e9e4148af528 None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:56.677166 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676c9ed1-1160-4370-b8a6-22846384b7c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:56.678885 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676c9ed1-1160-4370-b8a6-22846384b7c6 None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:56.679746 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676c9ed1-1160-4370-b8a6-22846384b7c6 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:56.680557 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676c9ed1-1160-4370-b8a6-22846384b7c6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:56.704397 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676c9ed1-1160-4370-b8a6-22846384b7c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:56.707703 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676c9ed1-1160-4370-b8a6-22846384b7c6 None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:56.722973 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:56.742437 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application [None req-676c9ed1-1160-4370-b8a6-22846384b7c6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:39:56.742437 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:39:56.742437 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:39:56.742437 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:39:56.742437 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:39:56.742437 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:39:56.742437 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:39:56.742437 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:39:56.742437 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:39:56.742437 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:39:56.742437 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:39:56.742437 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:39:56.742437 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 14:39:56.742437 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 14:39:56.742437 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 14:39:56.743584 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 14:39:56.743584 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:39:56.743584 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:39:56.743584 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:39:56.743584 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:39:56.743584 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:39:56.743584 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:39:56.743584 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:39:56.743584 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application with Lock( Jul 26 14:39:56.743584 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:39:56.743584 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:39:56.743584 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:39:56.743584 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:39:56.743584 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:39:56.743584 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:39:56.743584 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:39:56.743584 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:39:56.744756 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 14:39:56.744756 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 14:39:56.744756 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:39:56.744756 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Jul 26 14:39:56.750686 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 544/1063] 10.222.0.93 () {56 vars in 1108 bytes} [Tue Jul 26 14:39:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 14:39:56.751603 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf94b45-6ab5-4b82-93af-7642a292d3f6 None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:56.889569 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf94b45-6ab5-4b82-93af-7642a292d3f6 None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:56.934508 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b783ed-1720-4256-a9ee-fc4a3e154dd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:56.935394 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b783ed-1720-4256-a9ee-fc4a3e154dd6 None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:56.935817 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b783ed-1720-4256-a9ee-fc4a3e154dd6 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:56.936236 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b783ed-1720-4256-a9ee-fc4a3e154dd6 None admin] PATH_INFO: `/v3/domains` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:56.937148 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b783ed-1720-4256-a9ee-fc4a3e154dd6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:39:56.937609 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b783ed-1720-4256-a9ee-fc4a3e154dd6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:56.939215 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b783ed-1720-4256-a9ee-fc4a3e154dd6 None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:56.955640 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 520/1064] 10.222.0.93 () {56 vars in 1109 bytes} [Tue Jul 26 14:39:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:39:57.462870 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c736382-ca58-4715-83f0-31a74b596cef None None] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:57.463301 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c736382-ca58-4715-83f0-31a74b596cef None None] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:57.463738 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c736382-ca58-4715-83f0-31a74b596cef None None] PATH_INFO: `/` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:57.465333 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 545/1065] 10.222.0.93 () {54 vars in 926 bytes} [Tue Jul 26 14:39:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:39:57.472205 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f3fe8a-2b1d-4dca-ae98-43c75de4f3ad None None] REQUEST_METHOD: `POST` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:57.472506 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f3fe8a-2b1d-4dca-ae98-43c75de4f3ad None None] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:57.473022 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f3fe8a-2b1d-4dca-ae98-43c75de4f3ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:57.493445 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.auth.core [None req-40f3fe8a-2b1d-4dca-ae98-43c75de4f3ad None None] MFA Rules not processed for user `e5ef88cc058f425b882bcb87a1e1e75c`. Rule list: `[]` (Enabled: `True`). {{(pid=87055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:39:57.494867 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.fernet_utils [None req-40f3fe8a-2b1d-4dca-ae98-43c75de4f3ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:39:57.562037 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:57.574493 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 521/1066] 10.222.0.93 () {58 vars in 1023 bytes} [Tue Jul 26 14:39:57 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 26 14:39:57.598640 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c736382-ca58-4715-83f0-31a74b596cef None None] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:57.751501 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c736382-ca58-4715-83f0-31a74b596cef None None] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:57.821174 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112d9e76-039f-4cb8-bea3-489b38610c74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:57.822320 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112d9e76-039f-4cb8-bea3-489b38610c74 None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:57.822815 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112d9e76-039f-4cb8-bea3-489b38610c74 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:57.823298 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112d9e76-039f-4cb8-bea3-489b38610c74 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:57.845031 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112d9e76-039f-4cb8-bea3-489b38610c74 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 14:39:57.856496 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application [None req-112d9e76-039f-4cb8-bea3-489b38610c74 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 26 14:39:57.856496 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:39:57.856496 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:39:57.856496 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:39:57.856496 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:39:57.856496 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:39:57.856496 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:39:57.856496 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:39:57.856496 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:39:57.856496 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:39:57.856496 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:39:57.856496 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:39:57.856496 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 14:39:57.856496 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 14:39:57.856496 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 14:39:57.856496 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 14:39:57.857725 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 14:39:57.857725 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 14:39:57.857725 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 14:39:57.857725 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 14:39:57.857725 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:39:57.857725 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:39:57.857725 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:39:57.857725 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:39:57.857725 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:39:57.857725 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:39:57.857725 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:39:57.857725 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application with Lock( Jul 26 14:39:57.857725 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:39:57.857725 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:39:57.857725 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:39:57.857725 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:39:57.858799 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:39:57.858799 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:39:57.858799 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:39:57.858799 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:39:57.858799 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 14:39:57.858799 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 14:39:57.858799 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 14:39:57.858799 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 14:39:57.858799 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 14:39:57.858799 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 14:39:57.858799 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 26 14:39:57.858799 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Jul 26 14:39:57.858799 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 546/1067] 10.222.0.93 () {56 vars in 1120 bytes} [Tue Jul 26 14:39:57 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:39:57.869313 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f3fe8a-2b1d-4dca-ae98-43c75de4f3ad None None] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:58.045621 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f3fe8a-2b1d-4dca-ae98-43c75de4f3ad None None] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:58.090994 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e644ddb-e464-4a22-85ce-14c87847eadd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:58.092038 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e644ddb-e464-4a22-85ce-14c87847eadd None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:58.092523 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e644ddb-e464-4a22-85ce-14c87847eadd None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:58.093012 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e644ddb-e464-4a22-85ce-14c87847eadd None admin] PATH_INFO: `/v3/roles` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:58.094324 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e644ddb-e464-4a22-85ce-14c87847eadd None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=87055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:39:58.094864 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e644ddb-e464-4a22-85ce-14c87847eadd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:58.098039 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e644ddb-e464-4a22-85ce-14c87847eadd None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:58.112937 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 522/1068] 10.222.0.93 () {56 vars in 1115 bytes} [Tue Jul 26 14:39:57 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:39:58.118826 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112d9e76-039f-4cb8-bea3-489b38610c74 None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:58.207958 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:58.263288 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112d9e76-039f-4cb8-bea3-489b38610c74 None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:58.330637 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c14bf3-dd93-4465-be1f-b377ea0f24a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:58.331662 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c14bf3-dd93-4465-be1f-b377ea0f24a7 None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:58.332150 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c14bf3-dd93-4465-be1f-b377ea0f24a7 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:58.332636 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c14bf3-dd93-4465-be1f-b377ea0f24a7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:58.353623 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c14bf3-dd93-4465-be1f-b377ea0f24a7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:58.356423 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c14bf3-dd93-4465-be1f-b377ea0f24a7 None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:58.386090 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application [None req-f8c14bf3-dd93-4465-be1f-b377ea0f24a7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:39:58.386090 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:39:58.386090 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:39:58.386090 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:39:58.386090 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:39:58.386090 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:39:58.386090 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:39:58.386090 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:39:58.386090 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:39:58.386090 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:39:58.386090 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:39:58.386090 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:39:58.386090 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 14:39:58.386090 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 14:39:58.386090 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 14:39:58.388097 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 14:39:58.388097 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:39:58.388097 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:39:58.388097 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:39:58.388097 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:39:58.388097 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:39:58.388097 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:39:58.388097 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:39:58.388097 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application with Lock( Jul 26 14:39:58.388097 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:39:58.388097 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:39:58.388097 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:39:58.388097 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:39:58.388097 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:39:58.388097 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:39:58.388097 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:39:58.388097 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:39:58.389526 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 14:39:58.389526 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 14:39:58.389526 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:39:58.389526 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Jul 26 14:39:58.390433 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 547/1069] 10.222.0.93 () {56 vars in 1108 bytes} [Tue Jul 26 14:39:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:39:58.397330 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e644ddb-e464-4a22-85ce-14c87847eadd None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:58.471708 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:58.539369 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e644ddb-e464-4a22-85ce-14c87847eadd None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:58.580996 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f9e184-117a-462c-bbce-26e858852532 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:58.582123 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f9e184-117a-462c-bbce-26e858852532 None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:58.582123 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f9e184-117a-462c-bbce-26e858852532 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:58.582123 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f9e184-117a-462c-bbce-26e858852532 None admin] PATH_INFO: `/v3/domains` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:58.582876 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f9e184-117a-462c-bbce-26e858852532 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:39:58.583180 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f9e184-117a-462c-bbce-26e858852532 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:58.584579 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f9e184-117a-462c-bbce-26e858852532 None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:58.604985 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 523/1070] 10.222.0.93 () {56 vars in 1109 bytes} [Tue Jul 26 14:39:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:39:58.606861 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c14bf3-dd93-4465-be1f-b377ea0f24a7 None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:58.745235 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c14bf3-dd93-4465-be1f-b377ea0f24a7 None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:58.758489 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:58.787057 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e27c88e-6a85-4701-ac7c-db8bcfd9db66 None None] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:58.787505 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e27c88e-6a85-4701-ac7c-db8bcfd9db66 None None] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:58.787774 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d237656-6480-48c1-ab39-4fa4bd3a23c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:58.787951 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e27c88e-6a85-4701-ac7c-db8bcfd9db66 None None] PATH_INFO: `/` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:58.788931 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d237656-6480-48c1-ab39-4fa4bd3a23c9 None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:58.789368 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d237656-6480-48c1-ab39-4fa4bd3a23c9 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:58.789836 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d237656-6480-48c1-ab39-4fa4bd3a23c9 None admin] PATH_INFO: `/v3/users/nova` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:58.790338 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 524/1071] 10.222.0.93 () {54 vars in 926 bytes} [Tue Jul 26 14:39:58 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:39:58.800405 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8590e0-2734-4eb7-9a7f-cb439dbca3df None None] REQUEST_METHOD: `POST` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:58.801133 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8590e0-2734-4eb7-9a7f-cb439dbca3df None None] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:58.801587 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8590e0-2734-4eb7-9a7f-cb439dbca3df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:58.805085 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d237656-6480-48c1-ab39-4fa4bd3a23c9 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:58.807686 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d237656-6480-48c1-ab39-4fa4bd3a23c9 None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:58.823038 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application [None req-2d237656-6480-48c1-ab39-4fa4bd3a23c9 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 26 14:39:58.823038 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:39:58.823038 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:39:58.823038 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:39:58.823038 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:39:58.823038 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:39:58.823038 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:39:58.823038 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:39:58.823038 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:39:58.823038 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:39:58.823038 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:39:58.823038 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:39:58.823038 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 14:39:58.823038 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 14:39:58.823038 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 14:39:58.823038 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 14:39:58.824112 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:39:58.824112 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:39:58.824112 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 14:39:58.824112 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 14:39:58.824112 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 14:39:58.824112 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 14:39:58.824112 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:39:58.824112 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:39:58.824112 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:39:58.824112 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:39:58.824112 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:39:58.824112 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application with Lock( Jul 26 14:39:58.824112 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:39:58.824112 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:39:58.824112 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:39:58.824112 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:39:58.824112 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:39:58.824112 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:39:58.825073 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:39:58.825073 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:39:58.825073 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 14:39:58.825073 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 14:39:58.825073 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 14:39:58.825073 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 14:39:58.825073 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 14:39:58.825073 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 14:39:58.825073 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 26 14:39:58.825073 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Jul 26 14:39:58.825073 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 548/1072] 10.222.0.93 () {56 vars in 1093 bytes} [Tue Jul 26 14:39:58 2022] GET /identity/v3/users/nova => generated 82 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:39:58.825708 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.auth.core [None req-8c8590e0-2734-4eb7-9a7f-cb439dbca3df None None] MFA Rules not processed for user `e5ef88cc058f425b882bcb87a1e1e75c`. Rule list: `[]` (Enabled: `True`). {{(pid=87055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:39:58.826311 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.fernet_utils [None req-8c8590e0-2734-4eb7-9a7f-cb439dbca3df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:39:58.830320 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d237656-6480-48c1-ab39-4fa4bd3a23c9 None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:58.950287 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 525/1073] 10.222.0.93 () {58 vars in 1023 bytes} [Tue Jul 26 14:39:58 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 14:39:58.958948 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d237656-6480-48c1-ab39-4fa4bd3a23c9 None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:58.983736 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8590e0-2734-4eb7-9a7f-cb439dbca3df None None] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:59.006391 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5857fd5e-48c9-4c2e-9a47-4d6f739a03bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:59.007195 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5857fd5e-48c9-4c2e-9a47-4d6f739a03bd None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:59.007638 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5857fd5e-48c9-4c2e-9a47-4d6f739a03bd None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:59.007992 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5857fd5e-48c9-4c2e-9a47-4d6f739a03bd None admin] PATH_INFO: `/v3/users` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:59.009233 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5857fd5e-48c9-4c2e-9a47-4d6f739a03bd None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:39:59.009718 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5857fd5e-48c9-4c2e-9a47-4d6f739a03bd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:59.011921 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5857fd5e-48c9-4c2e-9a47-4d6f739a03bd None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:59.040803 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 549/1074] 10.222.0.93 () {56 vars in 1133 bytes} [Tue Jul 26 14:39:58 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:39:59.043666 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:59.047135 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5857fd5e-48c9-4c2e-9a47-4d6f739a03bd None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:59.095514 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:59.135869 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8590e0-2734-4eb7-9a7f-cb439dbca3df None None] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:59.183130 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c64555a-d97d-4925-b680-3abbdb5ac145 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:59.183800 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c64555a-d97d-4925-b680-3abbdb5ac145 None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:59.184082 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c64555a-d97d-4925-b680-3abbdb5ac145 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:59.184358 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c64555a-d97d-4925-b680-3abbdb5ac145 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:59.201032 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c64555a-d97d-4925-b680-3abbdb5ac145 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 14:39:59.206340 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application [None req-2c64555a-d97d-4925-b680-3abbdb5ac145 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 14:39:59.206340 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:39:59.206340 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:39:59.206340 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:39:59.206340 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:39:59.206340 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:39:59.206340 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:39:59.206340 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:39:59.206340 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:39:59.206340 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:39:59.206340 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:39:59.206340 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:39:59.206340 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 14:39:59.206340 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 14:39:59.206340 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 14:39:59.206340 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 14:39:59.212810 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 14:39:59.212810 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 14:39:59.212810 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 14:39:59.212810 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 14:39:59.212810 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:39:59.212810 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:39:59.212810 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:39:59.212810 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:39:59.212810 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:39:59.212810 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:39:59.212810 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:39:59.212810 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application with Lock( Jul 26 14:39:59.212810 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:39:59.212810 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:39:59.212810 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:39:59.212810 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:39:59.213937 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:39:59.213937 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:39:59.213937 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:39:59.213937 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:39:59.213937 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 14:39:59.213937 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 14:39:59.213937 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 14:39:59.213937 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 14:39:59.213937 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 14:39:59.213937 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 14:39:59.213937 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 14:39:59.213937 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Jul 26 14:39:59.213937 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 526/1075] 10.222.0.93 () {56 vars in 1096 bytes} [Tue Jul 26 14:39:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 14:39:59.214924 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c64555a-d97d-4925-b680-3abbdb5ac145 None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:59.218305 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5857fd5e-48c9-4c2e-9a47-4d6f739a03bd None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:59.266165 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a097f0-666c-432b-89eb-3ae51a1c469f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:59.267314 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a097f0-666c-432b-89eb-3ae51a1c469f None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:59.267813 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a097f0-666c-432b-89eb-3ae51a1c469f None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:59.268285 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a097f0-666c-432b-89eb-3ae51a1c469f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:59.286430 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a097f0-666c-432b-89eb-3ae51a1c469f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:59.287922 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a097f0-666c-432b-89eb-3ae51a1c469f None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:59.306428 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application [None req-96a097f0-666c-432b-89eb-3ae51a1c469f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:39:59.306428 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:39:59.306428 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:39:59.306428 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:39:59.306428 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:39:59.306428 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:39:59.306428 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:39:59.306428 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:39:59.306428 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:39:59.306428 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:39:59.306428 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:39:59.306428 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:39:59.306428 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 14:39:59.306428 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 14:39:59.306428 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 14:39:59.308257 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 14:39:59.308257 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:39:59.308257 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:39:59.308257 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:39:59.308257 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:39:59.308257 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:39:59.308257 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:39:59.308257 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:39:59.308257 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application with Lock( Jul 26 14:39:59.308257 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:39:59.308257 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:39:59.308257 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:39:59.308257 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:39:59.308257 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:39:59.308257 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:39:59.308257 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:39:59.308257 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:39:59.310165 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 14:39:59.310165 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 14:39:59.310165 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:39:59.310165 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Jul 26 14:39:59.310165 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 550/1076] 10.222.0.93 () {56 vars in 1108 bytes} [Tue Jul 26 14:39:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 14:39:59.314452 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a097f0-666c-432b-89eb-3ae51a1c469f None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:59.369989 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c64555a-d97d-4925-b680-3abbdb5ac145 None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:59.372679 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:59.413529 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:59.415137 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f03c32-cbfa-4148-88aa-49dbd7eab83b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:59.416050 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f03c32-cbfa-4148-88aa-49dbd7eab83b None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:59.416430 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f03c32-cbfa-4148-88aa-49dbd7eab83b None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:59.416811 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f03c32-cbfa-4148-88aa-49dbd7eab83b None admin] PATH_INFO: `/v3/roles` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:59.417744 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f03c32-cbfa-4148-88aa-49dbd7eab83b None admin] RBAC: Adding query filter params (name=admin) {{(pid=87055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:39:59.418150 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f03c32-cbfa-4148-88aa-49dbd7eab83b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:59.419704 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f03c32-cbfa-4148-88aa-49dbd7eab83b None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:59.439879 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 527/1077] 10.222.0.93 () {56 vars in 1099 bytes} [Tue Jul 26 14:39:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:39:59.441077 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f03c32-cbfa-4148-88aa-49dbd7eab83b None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:59.445679 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a097f0-666c-432b-89eb-3ae51a1c469f None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:59.494572 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c324855b-7015-48ff-a54f-873ba444c099 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:59.495375 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c324855b-7015-48ff-a54f-873ba444c099 None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:59.495877 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c324855b-7015-48ff-a54f-873ba444c099 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:59.496466 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c324855b-7015-48ff-a54f-873ba444c099 None admin] PATH_INFO: `/v3/domains` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:59.497617 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c324855b-7015-48ff-a54f-873ba444c099 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:39:59.497928 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c324855b-7015-48ff-a54f-873ba444c099 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:59.499561 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c324855b-7015-48ff-a54f-873ba444c099 None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:59.519231 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 551/1078] 10.222.0.93 () {56 vars in 1109 bytes} [Tue Jul 26 14:39:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:39:59.520979 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c324855b-7015-48ff-a54f-873ba444c099 None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:59.585792 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f03c32-cbfa-4148-88aa-49dbd7eab83b None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:59.626261 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba4ad0d-8211-4bd8-91dc-f908b777677a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:59.626925 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba4ad0d-8211-4bd8-91dc-f908b777677a None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:59.627216 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba4ad0d-8211-4bd8-91dc-f908b777677a None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:59.627496 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba4ad0d-8211-4bd8-91dc-f908b777677a None admin] PATH_INFO: `/v3/users/7266dd64c01e47959d0e1ab68628555b` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:59.629264 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba4ad0d-8211-4bd8-91dc-f908b777677a None admin] RBAC: Authorizing `identity:get_user(user_id=7266dd64c01e47959d0e1ab68628555b)` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:59.630800 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba4ad0d-8211-4bd8-91dc-f908b777677a None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:59.632451 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 528/1079] 10.222.0.93 () {56 vars in 1177 bytes} [Tue Jul 26 14:39:59 2022] GET /identity/v3/users/7266dd64c01e47959d0e1ab68628555b => generated 285 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:39:59.638333 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba4ad0d-8211-4bd8-91dc-f908b777677a None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:59.639566 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c324855b-7015-48ff-a54f-873ba444c099 None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:59.675753 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:59.678387 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f810766e-bbef-4917-9552-414a6a8ad988 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:59.679150 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f810766e-bbef-4917-9552-414a6a8ad988 None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:59.679471 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f810766e-bbef-4917-9552-414a6a8ad988 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:59.679777 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f810766e-bbef-4917-9552-414a6a8ad988 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:59.687877 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f810766e-bbef-4917-9552-414a6a8ad988 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:59.691126 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f810766e-bbef-4917-9552-414a6a8ad988 None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:59.693674 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:59.703710 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application [None req-f810766e-bbef-4917-9552-414a6a8ad988 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 14:39:59.703710 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:39:59.703710 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:39:59.703710 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:39:59.703710 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:39:59.703710 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:39:59.703710 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:39:59.703710 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:39:59.703710 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:39:59.703710 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:39:59.703710 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:39:59.703710 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:39:59.703710 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 14:39:59.703710 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 14:39:59.703710 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 14:39:59.705543 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 14:39:59.705543 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:39:59.705543 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:39:59.705543 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:39:59.705543 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:39:59.705543 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:39:59.705543 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:39:59.705543 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:39:59.705543 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application with Lock( Jul 26 14:39:59.705543 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:39:59.705543 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:39:59.705543 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:39:59.705543 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:39:59.705543 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:39:59.705543 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:39:59.705543 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:39:59.705543 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:39:59.707979 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 14:39:59.707979 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 14:39:59.707979 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 14:39:59.707979 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 14:39:59.707979 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 14:39:59.707979 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 14:39:59.707979 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 14:39:59.707979 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Jul 26 14:39:59.707979 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 552/1080] 10.222.0.93 () {56 vars in 1111 bytes} [Tue Jul 26 14:39:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:39:59.712928 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f810766e-bbef-4917-9552-414a6a8ad988 None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:59.767412 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba4ad0d-8211-4bd8-91dc-f908b777677a None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:59.812931 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40e041d-f0f6-4807-ad41-9462c9464564 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:59.813592 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40e041d-f0f6-4807-ad41-9462c9464564 None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:59.813876 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40e041d-f0f6-4807-ad41-9462c9464564 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:59.814158 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40e041d-f0f6-4807-ad41-9462c9464564 None admin] PATH_INFO: `/v3/projects/37b0bc0010c04c6bbdd5500d8e4b8f07` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:59.816041 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40e041d-f0f6-4807-ad41-9462c9464564 None admin] RBAC: Authorizing `identity:get_project(project_id=37b0bc0010c04c6bbdd5500d8e4b8f07)` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:59.817746 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40e041d-f0f6-4807-ad41-9462c9464564 None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:59.819775 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 529/1081] 10.222.0.93 () {56 vars in 1186 bytes} [Tue Jul 26 14:39:59 2022] GET /identity/v3/projects/37b0bc0010c04c6bbdd5500d8e4b8f07 => generated 311 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:39:59.827155 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40e041d-f0f6-4807-ad41-9462c9464564 None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:59.841642 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f810766e-bbef-4917-9552-414a6a8ad988 None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:39:59.909703 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba288990-bfea-4b67-a297-15eee0180d8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:39:59.910578 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba288990-bfea-4b67-a297-15eee0180d8b None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:39:59.910861 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba288990-bfea-4b67-a297-15eee0180d8b None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:39:59.911141 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba288990-bfea-4b67-a297-15eee0180d8b None admin] PATH_INFO: `/v3/projects` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:39:59.912009 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba288990-bfea-4b67-a297-15eee0180d8b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:39:59.912325 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba288990-bfea-4b67-a297-15eee0180d8b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:39:59.913803 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba288990-bfea-4b67-a297-15eee0180d8b None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:39:59.929518 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 553/1082] 10.222.0.93 () {56 vars in 1148 bytes} [Tue Jul 26 14:39:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:39:59.936030 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba288990-bfea-4b67-a297-15eee0180d8b None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:39:59.959259 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:59.962436 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40e041d-f0f6-4807-ad41-9462c9464564 None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:00.004994 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc155bb-8f07-482e-b46a-51bf0c94957c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:00.005689 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc155bb-8f07-482e-b46a-51bf0c94957c None admin] REQUEST_METHOD: `PUT` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:00.005971 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc155bb-8f07-482e-b46a-51bf0c94957c None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:00.006288 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc155bb-8f07-482e-b46a-51bf0c94957c None admin] PATH_INFO: `/v3/projects/37b0bc0010c04c6bbdd5500d8e4b8f07/users/7266dd64c01e47959d0e1ab68628555b/roles/94e105ff8ee4486abd501415cc05ba38` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:00.008470 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc155bb-8f07-482e-b46a-51bf0c94957c None admin] RBAC: Authorizing `identity:create_grant(project_id=37b0bc0010c04c6bbdd5500d8e4b8f07, user_id=7266dd64c01e47959d0e1ab68628555b, role_id=94e105ff8ee4486abd501415cc05ba38)` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:00.009928 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc155bb-8f07-482e-b46a-51bf0c94957c None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:00.020014 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:00.065221 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba288990-bfea-4b67-a297-15eee0180d8b None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:00.096190 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 530/1083] 10.222.0.93 () {58 vars in 1439 bytes} [Tue Jul 26 14:39:59 2022] PUT /identity/v3/projects/37b0bc0010c04c6bbdd5500d8e4b8f07/users/7266dd64c01e47959d0e1ab68628555b/roles/94e105ff8ee4486abd501415cc05ba38 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 14:40:00.108583 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb23ce1-a25f-4fec-85c4-554a3543e9fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:00.110512 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb23ce1-a25f-4fec-85c4-554a3543e9fe None admin] REQUEST_METHOD: `PUT` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:00.111031 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb23ce1-a25f-4fec-85c4-554a3543e9fe None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:00.111503 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb23ce1-a25f-4fec-85c4-554a3543e9fe None admin] PATH_INFO: `/v3/projects/c422a2290a14424da20e2841cbc1741d/users/2e86fe36c9bf49a481c9f15ac7571b88/roles/fb41e639164e46ba82e91c6a63dd4898` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:00.115848 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb23ce1-a25f-4fec-85c4-554a3543e9fe None admin] RBAC: Authorizing `identity:create_grant(project_id=c422a2290a14424da20e2841cbc1741d, user_id=2e86fe36c9bf49a481c9f15ac7571b88, role_id=fb41e639164e46ba82e91c6a63dd4898)` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:00.118045 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb23ce1-a25f-4fec-85c4-554a3543e9fe None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:00.207676 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 554/1084] 10.222.0.93 () {58 vars in 1439 bytes} [Tue Jul 26 14:39:59 2022] PUT /identity/v3/projects/c422a2290a14424da20e2841cbc1741d/users/2e86fe36c9bf49a481c9f15ac7571b88/roles/fb41e639164e46ba82e91c6a63dd4898 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 14:40:02.217035 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9281b86-9313-4bc9-ad09-ea95401326b6 None None] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:02.217614 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9281b86-9313-4bc9-ad09-ea95401326b6 None None] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:02.218049 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9281b86-9313-4bc9-ad09-ea95401326b6 None None] PATH_INFO: `/` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:02.220621 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 531/1085] 10.222.0.93 () {54 vars in 926 bytes} [Tue Jul 26 14:40:02 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:40:02.227940 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da073ada-e435-40cd-90f4-1b5b8af93bab None None] REQUEST_METHOD: `POST` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:02.228766 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da073ada-e435-40cd-90f4-1b5b8af93bab None None] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:02.228936 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da073ada-e435-40cd-90f4-1b5b8af93bab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:02.251174 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.auth.core [None req-da073ada-e435-40cd-90f4-1b5b8af93bab None None] MFA Rules not processed for user `e5ef88cc058f425b882bcb87a1e1e75c`. Rule list: `[]` (Enabled: `True`). {{(pid=87056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:40:02.252429 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.fernet_utils [None req-da073ada-e435-40cd-90f4-1b5b8af93bab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:40:02.341708 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 555/1086] 10.222.0.93 () {58 vars in 1023 bytes} [Tue Jul 26 14:40:02 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 14:40:02.351226 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7825d0-14b9-49b2-82ee-586f39ce6e19 None None] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:02.351707 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7825d0-14b9-49b2-82ee-586f39ce6e19 None None] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:02.352146 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7825d0-14b9-49b2-82ee-586f39ce6e19 None None] PATH_INFO: `/` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:02.354741 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 532/1087] 10.222.0.93 () {54 vars in 926 bytes} [Tue Jul 26 14:40:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:40:02.363927 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a3313a-7ca2-4770-bf66-a51b480e7c1a None None] REQUEST_METHOD: `POST` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:02.364421 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a3313a-7ca2-4770-bf66-a51b480e7c1a None None] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:02.365078 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a3313a-7ca2-4770-bf66-a51b480e7c1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:02.366587 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7825d0-14b9-49b2-82ee-586f39ce6e19 None None] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:02.396080 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.auth.core [None req-09a3313a-7ca2-4770-bf66-a51b480e7c1a None None] MFA Rules not processed for user `e5ef88cc058f425b882bcb87a1e1e75c`. Rule list: `[]` (Enabled: `True`). {{(pid=87056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:40:02.414952 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.fernet_utils [None req-09a3313a-7ca2-4770-bf66-a51b480e7c1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:40:02.461657 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:02.485816 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 556/1088] 10.222.0.93 () {58 vars in 1023 bytes} [Tue Jul 26 14:40:02 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 14:40:02.511222 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a3313a-7ca2-4770-bf66-a51b480e7c1a None None] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:02.550473 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7825d0-14b9-49b2-82ee-586f39ce6e19 None None] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:02.600915 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cce913-4bfc-4128-9f78-3e73a09574fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:02.601576 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cce913-4bfc-4128-9f78-3e73a09574fc None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:02.601861 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cce913-4bfc-4128-9f78-3e73a09574fc None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:02.602130 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cce913-4bfc-4128-9f78-3e73a09574fc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:02.617065 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cce913-4bfc-4128-9f78-3e73a09574fc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 14:40:02.622312 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application [None req-47cce913-4bfc-4128-9f78-3e73a09574fc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 14:40:02.622312 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:40:02.622312 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:40:02.622312 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:40:02.622312 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:40:02.622312 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:40:02.622312 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:40:02.622312 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:40:02.622312 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:40:02.622312 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:40:02.622312 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:40:02.622312 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:40:02.622312 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 14:40:02.622312 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 14:40:02.622312 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 14:40:02.622312 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 14:40:02.625747 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 14:40:02.625747 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 14:40:02.625747 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 14:40:02.625747 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 14:40:02.625747 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:40:02.625747 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:40:02.625747 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:40:02.625747 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:40:02.625747 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:40:02.625747 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:40:02.625747 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:40:02.625747 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application with Lock( Jul 26 14:40:02.625747 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:40:02.625747 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:40:02.625747 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:40:02.625747 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:40:02.626618 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:40:02.626618 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:40:02.626618 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:40:02.626618 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:40:02.626618 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 14:40:02.626618 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 14:40:02.626618 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 14:40:02.626618 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 14:40:02.626618 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 14:40:02.626618 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 14:40:02.626618 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 14:40:02.626618 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Jul 26 14:40:02.626618 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 533/1089] 10.222.0.93 () {56 vars in 1096 bytes} [Tue Jul 26 14:40:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:40:02.632064 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cce913-4bfc-4128-9f78-3e73a09574fc None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:02.655880 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a3313a-7ca2-4770-bf66-a51b480e7c1a None None] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:02.672080 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:02.708856 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074f6ec0-c595-4b7a-b768-817b73b91278 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:02.709522 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074f6ec0-c595-4b7a-b768-817b73b91278 None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:02.709805 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074f6ec0-c595-4b7a-b768-817b73b91278 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:02.710079 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074f6ec0-c595-4b7a-b768-817b73b91278 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:02.723035 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074f6ec0-c595-4b7a-b768-817b73b91278 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 14:40:02.728013 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application [None req-074f6ec0-c595-4b7a-b768-817b73b91278 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 26 14:40:02.728013 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:40:02.728013 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:40:02.728013 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:40:02.728013 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:40:02.728013 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:40:02.728013 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:40:02.728013 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:40:02.728013 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:40:02.728013 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:40:02.728013 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:40:02.728013 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:40:02.728013 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 14:40:02.728013 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 14:40:02.728013 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 14:40:02.728013 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 14:40:02.729178 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 14:40:02.729178 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 14:40:02.729178 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 14:40:02.729178 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 14:40:02.729178 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:40:02.729178 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:40:02.729178 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:40:02.729178 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:40:02.729178 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:40:02.729178 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:40:02.729178 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:40:02.729178 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application with Lock( Jul 26 14:40:02.729178 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:40:02.729178 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:40:02.729178 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:40:02.729178 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:40:02.730749 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:40:02.730749 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:40:02.730749 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:40:02.730749 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:40:02.730749 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 14:40:02.730749 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 14:40:02.730749 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 14:40:02.730749 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 14:40:02.730749 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 14:40:02.730749 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 14:40:02.730749 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 26 14:40:02.730749 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Jul 26 14:40:02.730749 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 557/1090] 10.222.0.93 () {56 vars in 1120 bytes} [Tue Jul 26 14:40:02 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 14:40:02.738332 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074f6ec0-c595-4b7a-b768-817b73b91278 None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:02.789981 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:02.816611 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cce913-4bfc-4128-9f78-3e73a09574fc None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:02.866849 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20198f2-a0de-42a0-8c13-594565f72220 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:02.867726 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20198f2-a0de-42a0-8c13-594565f72220 None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:02.868085 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20198f2-a0de-42a0-8c13-594565f72220 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:02.868488 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20198f2-a0de-42a0-8c13-594565f72220 None admin] PATH_INFO: `/v3/roles` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:02.869381 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20198f2-a0de-42a0-8c13-594565f72220 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:40:02.869808 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20198f2-a0de-42a0-8c13-594565f72220 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:02.871522 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20198f2-a0de-42a0-8c13-594565f72220 None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:02.872111 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074f6ec0-c595-4b7a-b768-817b73b91278 None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:02.891382 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 534/1091] 10.222.0.93 () {56 vars in 1099 bytes} [Tue Jul 26 14:40:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:40:02.893150 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20198f2-a0de-42a0-8c13-594565f72220 None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:02.923030 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a66d804-c74e-404c-ba66-f95300205741 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:02.923921 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a66d804-c74e-404c-ba66-f95300205741 None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:02.924250 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a66d804-c74e-404c-ba66-f95300205741 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:02.925332 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a66d804-c74e-404c-ba66-f95300205741 None admin] PATH_INFO: `/v3/roles` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:02.926112 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a66d804-c74e-404c-ba66-f95300205741 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=87056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:40:02.926520 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a66d804-c74e-404c-ba66-f95300205741 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:02.928147 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a66d804-c74e-404c-ba66-f95300205741 None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:02.938944 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 558/1092] 10.222.0.93 () {56 vars in 1115 bytes} [Tue Jul 26 14:40:02 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:40:02.946457 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a66d804-c74e-404c-ba66-f95300205741 None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:03.008534 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:03.040454 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20198f2-a0de-42a0-8c13-594565f72220 None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:03.088838 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a66d804-c74e-404c-ba66-f95300205741 None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:03.090372 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5aa3e0-7685-477e-a27f-4bf95b23525e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:03.091400 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5aa3e0-7685-477e-a27f-4bf95b23525e None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:03.091772 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5aa3e0-7685-477e-a27f-4bf95b23525e None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:03.091987 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:03.092238 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5aa3e0-7685-477e-a27f-4bf95b23525e None admin] PATH_INFO: `/v3/users/7266dd64c01e47959d0e1ab68628555b` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:03.094079 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5aa3e0-7685-477e-a27f-4bf95b23525e None admin] RBAC: Authorizing `identity:get_user(user_id=7266dd64c01e47959d0e1ab68628555b)` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:03.097098 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5aa3e0-7685-477e-a27f-4bf95b23525e None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:03.107852 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 535/1093] 10.222.0.93 () {56 vars in 1177 bytes} [Tue Jul 26 14:40:02 2022] GET /identity/v3/users/7266dd64c01e47959d0e1ab68628555b => generated 285 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:40:03.109059 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5aa3e0-7685-477e-a27f-4bf95b23525e None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:03.138326 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe61b17-3f64-44b2-b86d-527b56ce19e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:03.139362 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe61b17-3f64-44b2-b86d-527b56ce19e5 None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:03.139831 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe61b17-3f64-44b2-b86d-527b56ce19e5 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:03.140298 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe61b17-3f64-44b2-b86d-527b56ce19e5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:03.153950 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe61b17-3f64-44b2-b86d-527b56ce19e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:03.155573 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe61b17-3f64-44b2-b86d-527b56ce19e5 None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:03.173990 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application [None req-cbe61b17-3f64-44b2-b86d-527b56ce19e5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:40:03.173990 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:40:03.173990 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:40:03.173990 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:40:03.173990 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:40:03.173990 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:40:03.173990 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:40:03.173990 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:40:03.173990 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:40:03.173990 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:40:03.173990 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:40:03.173990 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:40:03.173990 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 14:40:03.173990 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 14:40:03.173990 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 14:40:03.176535 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 14:40:03.176535 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:40:03.176535 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:40:03.176535 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:40:03.176535 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:40:03.176535 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:40:03.176535 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:40:03.176535 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:40:03.176535 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application with Lock( Jul 26 14:40:03.176535 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:40:03.176535 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:40:03.176535 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:40:03.176535 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:40:03.176535 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:40:03.176535 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:40:03.176535 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:40:03.176535 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:40:03.177763 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 14:40:03.177763 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 14:40:03.177763 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:40:03.177763 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Jul 26 14:40:03.181305 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 559/1094] 10.222.0.93 () {56 vars in 1108 bytes} [Tue Jul 26 14:40:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 14:40:03.182297 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe61b17-3f64-44b2-b86d-527b56ce19e5 None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:03.250908 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5aa3e0-7685-477e-a27f-4bf95b23525e None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:03.292173 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f280cdf-cdb6-4393-a673-0ed6c58d08bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:03.292703 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f280cdf-cdb6-4393-a673-0ed6c58d08bd None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:03.292981 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f280cdf-cdb6-4393-a673-0ed6c58d08bd None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:03.293253 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f280cdf-cdb6-4393-a673-0ed6c58d08bd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:03.315746 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:03.342190 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe61b17-3f64-44b2-b86d-527b56ce19e5 None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:03.387581 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bed4ea-f653-4062-a783-39cf9bcd8f6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:03.388381 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bed4ea-f653-4062-a783-39cf9bcd8f6a None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:03.388694 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bed4ea-f653-4062-a783-39cf9bcd8f6a None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:03.389037 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bed4ea-f653-4062-a783-39cf9bcd8f6a None admin] PATH_INFO: `/v3/domains` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:03.390121 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bed4ea-f653-4062-a783-39cf9bcd8f6a None admin] RBAC: Adding query filter params (name=Default) {{(pid=87056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:40:03.390510 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bed4ea-f653-4062-a783-39cf9bcd8f6a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:03.392019 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f280cdf-cdb6-4393-a673-0ed6c58d08bd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:03.392230 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bed4ea-f653-4062-a783-39cf9bcd8f6a None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:03.394054 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f280cdf-cdb6-4393-a673-0ed6c58d08bd None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:03.407429 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 560/1095] 10.222.0.93 () {56 vars in 1109 bytes} [Tue Jul 26 14:40:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:40:03.414405 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bed4ea-f653-4062-a783-39cf9bcd8f6a None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:03.434433 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:03.540752 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 536/1096] 10.222.0.93 () {58 vars in 1282 bytes} [Tue Jul 26 14:40:03 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 26 14:40:03.547250 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f280cdf-cdb6-4393-a673-0ed6c58d08bd None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:03.558123 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bed4ea-f653-4062-a783-39cf9bcd8f6a None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:03.599113 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ed1b8f-828d-4960-b983-5cfba6f2330d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:03.599782 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ed1b8f-828d-4960-b983-5cfba6f2330d None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:03.600063 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ed1b8f-828d-4960-b983-5cfba6f2330d None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:03.600340 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ed1b8f-828d-4960-b983-5cfba6f2330d None admin] PATH_INFO: `/v3/users/nova` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:03.608738 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ed1b8f-828d-4960-b983-5cfba6f2330d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:03.610228 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ed1b8f-828d-4960-b983-5cfba6f2330d None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:03.613042 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:03.623944 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application [None req-01ed1b8f-828d-4960-b983-5cfba6f2330d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 26 14:40:03.623944 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:40:03.623944 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:40:03.623944 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:40:03.623944 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:40:03.623944 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:40:03.623944 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:40:03.623944 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:40:03.623944 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:40:03.623944 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:40:03.623944 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:40:03.623944 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:40:03.623944 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 14:40:03.623944 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 14:40:03.623944 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 14:40:03.623944 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 14:40:03.625256 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:40:03.625256 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:40:03.625256 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 14:40:03.625256 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 14:40:03.625256 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 14:40:03.625256 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 14:40:03.625256 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:40:03.625256 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:40:03.625256 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:40:03.625256 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:40:03.625256 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:40:03.625256 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application with Lock( Jul 26 14:40:03.625256 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:40:03.625256 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:40:03.625256 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:40:03.625256 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:40:03.625256 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:40:03.625256 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:40:03.632260 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:40:03.632260 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:40:03.632260 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 14:40:03.632260 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 14:40:03.632260 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 14:40:03.632260 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 14:40:03.632260 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 14:40:03.632260 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 14:40:03.632260 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 26 14:40:03.632260 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Jul 26 14:40:03.632260 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 561/1097] 10.222.0.93 () {56 vars in 1093 bytes} [Tue Jul 26 14:40:03 2022] GET /identity/v3/users/nova => generated 82 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 14:40:03.632260 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ed1b8f-828d-4960-b983-5cfba6f2330d None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:03.673251 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f280cdf-cdb6-4393-a673-0ed6c58d08bd None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:03.722970 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c8087d-90ab-4f16-b85a-7e51985b79c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:03.723923 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c8087d-90ab-4f16-b85a-7e51985b79c4 None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:03.724357 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c8087d-90ab-4f16-b85a-7e51985b79c4 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:03.724807 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c8087d-90ab-4f16-b85a-7e51985b79c4 None admin] PATH_INFO: `/v3/projects/37b0bc0010c04c6bbdd5500d8e4b8f07` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:03.726931 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c8087d-90ab-4f16-b85a-7e51985b79c4 None admin] RBAC: Authorizing `identity:get_project(project_id=37b0bc0010c04c6bbdd5500d8e4b8f07)` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:03.729419 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c8087d-90ab-4f16-b85a-7e51985b79c4 None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:03.738045 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 537/1098] 10.222.0.93 () {56 vars in 1186 bytes} [Tue Jul 26 14:40:03 2022] GET /identity/v3/projects/37b0bc0010c04c6bbdd5500d8e4b8f07 => generated 311 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:40:03.739831 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c8087d-90ab-4f16-b85a-7e51985b79c4 None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:03.744966 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:03.784623 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ed1b8f-828d-4960-b983-5cfba6f2330d None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:03.829281 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c862ef89-3e6f-44a4-b6fb-6a85d892f141 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:03.829922 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c862ef89-3e6f-44a4-b6fb-6a85d892f141 None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:03.830297 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c862ef89-3e6f-44a4-b6fb-6a85d892f141 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:03.830581 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c862ef89-3e6f-44a4-b6fb-6a85d892f141 None admin] PATH_INFO: `/v3/users` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:03.831569 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c862ef89-3e6f-44a4-b6fb-6a85d892f141 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:40:03.831881 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c862ef89-3e6f-44a4-b6fb-6a85d892f141 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:03.833379 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c862ef89-3e6f-44a4-b6fb-6a85d892f141 None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:03.853098 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 562/1099] 10.222.0.93 () {56 vars in 1133 bytes} [Tue Jul 26 14:40:03 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:40:03.859311 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c862ef89-3e6f-44a4-b6fb-6a85d892f141 None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:03.874480 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c8087d-90ab-4f16-b85a-7e51985b79c4 None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:03.895899 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:03.916353 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400bbec4-73bf-4822-8a53-ec17163aae7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:03.917660 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400bbec4-73bf-4822-8a53-ec17163aae7c None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:03.918125 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400bbec4-73bf-4822-8a53-ec17163aae7c None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:03.918629 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400bbec4-73bf-4822-8a53-ec17163aae7c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:03.919876 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400bbec4-73bf-4822-8a53-ec17163aae7c None admin] RBAC: Adding query filter params (role.id=94e105ff8ee4486abd501415cc05ba38, scope.project.id=37b0bc0010c04c6bbdd5500d8e4b8f07, user.id=7266dd64c01e47959d0e1ab68628555b) {{(pid=87055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:40:03.920384 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400bbec4-73bf-4822-8a53-ec17163aae7c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:03.923035 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400bbec4-73bf-4822-8a53-ec17163aae7c None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:03.934030 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 538/1100] 10.222.0.93 () {56 vars in 1374 bytes} [Tue Jul 26 14:40:03 2022] GET /identity/v3/role_assignments?user.id=7266dd64c01e47959d0e1ab68628555b&scope.project.id=37b0bc0010c04c6bbdd5500d8e4b8f07&role.id=94e105ff8ee4486abd501415cc05ba38 => generated 608 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:40:03.985625 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c862ef89-3e6f-44a4-b6fb-6a85d892f141 None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:04.024344 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:04.029888 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5408a07-d430-42b5-8dc6-454ea25e83fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:04.030582 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5408a07-d430-42b5-8dc6-454ea25e83fc None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:04.030872 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5408a07-d430-42b5-8dc6-454ea25e83fc None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:04.031150 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5408a07-d430-42b5-8dc6-454ea25e83fc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:04.115736 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5408a07-d430-42b5-8dc6-454ea25e83fc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:04.117334 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5408a07-d430-42b5-8dc6-454ea25e83fc None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:04.239276 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 563/1101] 10.222.0.93 () {58 vars in 1282 bytes} [Tue Jul 26 14:40:03 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 26 14:40:04.245473 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400bbec4-73bf-4822-8a53-ec17163aae7c None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:04.362327 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400bbec4-73bf-4822-8a53-ec17163aae7c None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:04.400277 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d064cee-eaf4-4b8d-9782-9684fb1b7f09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:04.400852 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d064cee-eaf4-4b8d-9782-9684fb1b7f09 None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:04.401141 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d064cee-eaf4-4b8d-9782-9684fb1b7f09 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:04.401415 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d064cee-eaf4-4b8d-9782-9684fb1b7f09 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:04.414729 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d064cee-eaf4-4b8d-9782-9684fb1b7f09 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:04.416219 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d064cee-eaf4-4b8d-9782-9684fb1b7f09 None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:04.432758 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application [None req-2d064cee-eaf4-4b8d-9782-9684fb1b7f09 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:40:04.432758 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:40:04.432758 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:40:04.432758 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:40:04.432758 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:40:04.432758 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:40:04.432758 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:40:04.432758 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:40:04.432758 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:40:04.432758 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:40:04.432758 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:40:04.432758 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:40:04.432758 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 14:40:04.432758 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 14:40:04.432758 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 14:40:04.433774 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 14:40:04.433774 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:40:04.433774 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:40:04.433774 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:40:04.433774 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:40:04.433774 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:40:04.433774 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:40:04.433774 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:40:04.433774 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application with Lock( Jul 26 14:40:04.433774 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:40:04.433774 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:40:04.433774 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:40:04.433774 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:40:04.433774 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:40:04.433774 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:40:04.433774 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:40:04.433774 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:40:04.434723 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 14:40:04.434723 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 14:40:04.434723 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:40:04.434723 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Jul 26 14:40:04.434723 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 539/1102] 10.222.0.93 () {56 vars in 1108 bytes} [Tue Jul 26 14:40:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:40:04.439930 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5408a07-d430-42b5-8dc6-454ea25e83fc None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:04.476971 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:04.555313 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5408a07-d430-42b5-8dc6-454ea25e83fc None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:04.594181 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b5dd4d-e457-4723-8fea-e40557547f6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:04.594853 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b5dd4d-e457-4723-8fea-e40557547f6e None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:04.595137 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b5dd4d-e457-4723-8fea-e40557547f6e None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:04.595421 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b5dd4d-e457-4723-8fea-e40557547f6e None admin] PATH_INFO: `/v3/domains` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:04.596132 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b5dd4d-e457-4723-8fea-e40557547f6e None admin] RBAC: Adding query filter params (name=Default) {{(pid=87056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:40:04.596499 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b5dd4d-e457-4723-8fea-e40557547f6e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:04.597924 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b5dd4d-e457-4723-8fea-e40557547f6e None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:04.611364 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 564/1103] 10.222.0.93 () {56 vars in 1109 bytes} [Tue Jul 26 14:40:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:40:04.617926 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d064cee-eaf4-4b8d-9782-9684fb1b7f09 None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:04.661712 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:04.751748 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d064cee-eaf4-4b8d-9782-9684fb1b7f09 None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:04.801146 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf80e87-e356-45b5-91d1-1c44a4078688 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:04.802298 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf80e87-e356-45b5-91d1-1c44a4078688 None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:04.802762 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf80e87-e356-45b5-91d1-1c44a4078688 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:04.803253 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf80e87-e356-45b5-91d1-1c44a4078688 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:04.817265 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf80e87-e356-45b5-91d1-1c44a4078688 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:04.820076 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf80e87-e356-45b5-91d1-1c44a4078688 None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:04.843315 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application [None req-baf80e87-e356-45b5-91d1-1c44a4078688 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 14:40:04.843315 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:40:04.843315 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:40:04.843315 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:40:04.843315 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:40:04.843315 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:40:04.843315 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:40:04.843315 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:40:04.843315 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:40:04.843315 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:40:04.843315 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:40:04.843315 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:40:04.843315 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 14:40:04.843315 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 14:40:04.843315 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 14:40:04.845220 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 14:40:04.845220 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:40:04.845220 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:40:04.845220 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:40:04.845220 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:40:04.845220 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:40:04.845220 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:40:04.845220 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:40:04.845220 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application with Lock( Jul 26 14:40:04.845220 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:40:04.845220 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:40:04.845220 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:40:04.845220 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:40:04.845220 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:40:04.845220 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:40:04.845220 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:40:04.845220 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:40:04.846775 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 14:40:04.846775 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 14:40:04.846775 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 14:40:04.846775 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 14:40:04.846775 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 14:40:04.846775 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 14:40:04.846775 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 14:40:04.846775 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Jul 26 14:40:04.850496 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 540/1104] 10.222.0.93 () {56 vars in 1111 bytes} [Tue Jul 26 14:40:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 14:40:04.855186 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b5dd4d-e457-4723-8fea-e40557547f6e None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:04.972402 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:04.983955 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b5dd4d-e457-4723-8fea-e40557547f6e None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:05.028859 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d537a784-6048-4fe0-9ad2-d4ddacb11a7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:05.029509 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d537a784-6048-4fe0-9ad2-d4ddacb11a7d None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:05.029793 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d537a784-6048-4fe0-9ad2-d4ddacb11a7d None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:05.030070 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d537a784-6048-4fe0-9ad2-d4ddacb11a7d None admin] PATH_INFO: `/v3/projects` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:05.030890 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d537a784-6048-4fe0-9ad2-d4ddacb11a7d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:40:05.031454 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d537a784-6048-4fe0-9ad2-d4ddacb11a7d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:05.032979 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d537a784-6048-4fe0-9ad2-d4ddacb11a7d None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:05.046989 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 565/1105] 10.222.0.93 () {56 vars in 1148 bytes} [Tue Jul 26 14:40:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:40:05.054806 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf80e87-e356-45b5-91d1-1c44a4078688 None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:05.195499 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:05.204043 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf80e87-e356-45b5-91d1-1c44a4078688 None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:05.247251 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c516103b-b478-4b34-a9a5-319a218a21f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:05.247777 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c516103b-b478-4b34-a9a5-319a218a21f9 None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:05.248062 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c516103b-b478-4b34-a9a5-319a218a21f9 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:05.248338 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c516103b-b478-4b34-a9a5-319a218a21f9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:05.249153 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c516103b-b478-4b34-a9a5-319a218a21f9 None admin] RBAC: Adding query filter params (role.id=fb41e639164e46ba82e91c6a63dd4898, scope.project.id=c422a2290a14424da20e2841cbc1741d, user.id=2e86fe36c9bf49a481c9f15ac7571b88) {{(pid=87055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:40:05.249536 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c516103b-b478-4b34-a9a5-319a218a21f9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:05.251070 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c516103b-b478-4b34-a9a5-319a218a21f9 None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:05.259992 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 541/1106] 10.222.0.93 () {56 vars in 1374 bytes} [Tue Jul 26 14:40:05 2022] GET /identity/v3/role_assignments?user.id=2e86fe36c9bf49a481c9f15ac7571b88&scope.project.id=c422a2290a14424da20e2841cbc1741d&role.id=fb41e639164e46ba82e91c6a63dd4898 => generated 608 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:40:06.147442 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4581570-6e0d-4a03-a04b-df833d42e53e None None] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:06.148223 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4581570-6e0d-4a03-a04b-df833d42e53e None None] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:06.148223 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4581570-6e0d-4a03-a04b-df833d42e53e None None] PATH_INFO: `/` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:06.149474 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 566/1107] 10.222.0.93 () {54 vars in 926 bytes} [Tue Jul 26 14:40:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:40:06.156904 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df801a87-f7d3-48ef-9aa2-f2cfa3606768 None None] REQUEST_METHOD: `POST` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:06.157608 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df801a87-f7d3-48ef-9aa2-f2cfa3606768 None None] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:06.157845 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df801a87-f7d3-48ef-9aa2-f2cfa3606768 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:06.184947 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.auth.core [None req-df801a87-f7d3-48ef-9aa2-f2cfa3606768 None None] MFA Rules not processed for user `e5ef88cc058f425b882bcb87a1e1e75c`. Rule list: `[]` (Enabled: `True`). {{(pid=87055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:40:06.186886 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.fernet_utils [None req-df801a87-f7d3-48ef-9aa2-f2cfa3606768 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:40:06.298825 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 542/1108] 10.222.0.93 () {58 vars in 1023 bytes} [Tue Jul 26 14:40:06 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 14:40:06.334826 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4581570-6e0d-4a03-a04b-df833d42e53e None None] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:06.459802 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4581570-6e0d-4a03-a04b-df833d42e53e None None] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:06.499434 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd8e9a4-2423-4081-8657-09f973fe75d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:06.500133 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd8e9a4-2423-4081-8657-09f973fe75d3 None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:06.500408 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd8e9a4-2423-4081-8657-09f973fe75d3 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:06.500677 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd8e9a4-2423-4081-8657-09f973fe75d3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:06.501865 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd8e9a4-2423-4081-8657-09f973fe75d3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:06.503495 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd8e9a4-2423-4081-8657-09f973fe75d3 None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:06.505417 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 567/1109] 10.222.0.93 () {56 vars in 1108 bytes} [Tue Jul 26 14:40:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:40:06.513491 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df801a87-f7d3-48ef-9aa2-f2cfa3606768 None None] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:06.631768 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:06.645457 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df801a87-f7d3-48ef-9aa2-f2cfa3606768 None None] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:06.685182 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee746ee-1da1-4c87-9ea7-64be7614e6fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:06.685816 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee746ee-1da1-4c87-9ea7-64be7614e6fc None admin] REQUEST_METHOD: `POST` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:06.686099 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee746ee-1da1-4c87-9ea7-64be7614e6fc None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:06.686407 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee746ee-1da1-4c87-9ea7-64be7614e6fc None admin] PATH_INFO: `/v3/users` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:06.687109 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee746ee-1da1-4c87-9ea7-64be7614e6fc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:06.688661 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee746ee-1da1-4c87-9ea7-64be7614e6fc None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:06.839235 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 543/1110] 10.222.0.93 () {60 vars in 1132 bytes} [Tue Jul 26 14:40:06 2022] POST /identity/v3/users => generated 286 bytes in 327 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 14:40:09.037528 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be23655a-19c3-4e7e-82b4-ad1ebe55d205 None None] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:09.038091 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be23655a-19c3-4e7e-82b4-ad1ebe55d205 None None] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:09.038416 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be23655a-19c3-4e7e-82b4-ad1ebe55d205 None None] PATH_INFO: `/` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:09.041041 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 568/1111] 10.222.0.93 () {54 vars in 926 bytes} [Tue Jul 26 14:40:09 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:40:09.052117 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576ffb87-b774-46c0-82fc-0766595616df None None] REQUEST_METHOD: `POST` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:09.052665 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576ffb87-b774-46c0-82fc-0766595616df None None] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:09.053041 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576ffb87-b774-46c0-82fc-0766595616df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:09.085432 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.auth.core [None req-576ffb87-b774-46c0-82fc-0766595616df None None] MFA Rules not processed for user `e5ef88cc058f425b882bcb87a1e1e75c`. Rule list: `[]` (Enabled: `True`). {{(pid=87055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:40:09.087488 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.fernet_utils [None req-576ffb87-b774-46c0-82fc-0766595616df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:40:09.214417 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 544/1112] 10.222.0.93 () {58 vars in 1023 bytes} [Tue Jul 26 14:40:09 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 14:40:09.241707 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be23655a-19c3-4e7e-82b4-ad1ebe55d205 None None] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:09.266570 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:09.363932 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be23655a-19c3-4e7e-82b4-ad1ebe55d205 None None] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:09.405407 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd0f1a2-8a34-4a66-935f-93dbc5d5a3f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:09.406078 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd0f1a2-8a34-4a66-935f-93dbc5d5a3f5 None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:09.406667 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd0f1a2-8a34-4a66-935f-93dbc5d5a3f5 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:09.406948 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd0f1a2-8a34-4a66-935f-93dbc5d5a3f5 None admin] PATH_INFO: `/v3/roles/ef1a806f8d774452a6536b57a4670ceb` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:09.409657 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd0f1a2-8a34-4a66-935f-93dbc5d5a3f5 None admin] RBAC: Authorizing `identity:get_role(role_id=ef1a806f8d774452a6536b57a4670ceb)` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:09.411169 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd0f1a2-8a34-4a66-935f-93dbc5d5a3f5 None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:09.412618 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 569/1113] 10.222.0.93 () {56 vars in 1177 bytes} [Tue Jul 26 14:40:09 2022] GET /identity/v3/roles/ef1a806f8d774452a6536b57a4670ceb => generated 223 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:40:09.419103 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576ffb87-b774-46c0-82fc-0766595616df None None] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:09.623488 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:09.674882 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576ffb87-b774-46c0-82fc-0766595616df None None] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:09.722789 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dadba6-1cd7-47ee-8635-4204e5b06ad9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:09.726375 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dadba6-1cd7-47ee-8635-4204e5b06ad9 None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:09.726375 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dadba6-1cd7-47ee-8635-4204e5b06ad9 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:09.726375 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dadba6-1cd7-47ee-8635-4204e5b06ad9 None admin] PATH_INFO: `/v3/users/f8cb41b2e40b4dff8dc397926d0f1f38` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:09.740450 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86dadba6-1cd7-47ee-8635-4204e5b06ad9 None admin] RBAC: Authorizing `identity:get_user(user_id=f8cb41b2e40b4dff8dc397926d0f1f38)` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:09.742002 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86dadba6-1cd7-47ee-8635-4204e5b06ad9 None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:09.744169 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 545/1114] 10.222.0.93 () {56 vars in 1177 bytes} [Tue Jul 26 14:40:09 2022] GET /identity/v3/users/f8cb41b2e40b4dff8dc397926d0f1f38 => generated 286 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:40:09.839156 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd0f1a2-8a34-4a66-935f-93dbc5d5a3f5 None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:09.858885 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:09.874876 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd0f1a2-8a34-4a66-935f-93dbc5d5a3f5 None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:09.930957 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fff69cc-80c2-4d6b-b6ae-e4a7c2aece66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:09.932069 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fff69cc-80c2-4d6b-b6ae-e4a7c2aece66 None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:09.932572 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fff69cc-80c2-4d6b-b6ae-e4a7c2aece66 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:09.933045 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fff69cc-80c2-4d6b-b6ae-e4a7c2aece66 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:10.067029 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fff69cc-80c2-4d6b-b6ae-e4a7c2aece66 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:10.069801 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fff69cc-80c2-4d6b-b6ae-e4a7c2aece66 None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:10.186535 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:10.200800 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 570/1115] 10.222.0.93 () {58 vars in 1282 bytes} [Tue Jul 26 14:40:09 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 450 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 26 14:40:10.207874 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dadba6-1cd7-47ee-8635-4204e5b06ad9 None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:10.337465 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dadba6-1cd7-47ee-8635-4204e5b06ad9 None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:10.376461 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:10.383276 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd9dd4e-90c6-4965-9384-8634cbc78737 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:10.385247 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd9dd4e-90c6-4965-9384-8634cbc78737 None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:10.385247 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd9dd4e-90c6-4965-9384-8634cbc78737 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:10.385247 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd9dd4e-90c6-4965-9384-8634cbc78737 None admin] PATH_INFO: `/v3/projects/37b0bc0010c04c6bbdd5500d8e4b8f07` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:10.386113 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd9dd4e-90c6-4965-9384-8634cbc78737 None admin] RBAC: Authorizing `identity:get_project(project_id=37b0bc0010c04c6bbdd5500d8e4b8f07)` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:10.387880 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd9dd4e-90c6-4965-9384-8634cbc78737 None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:10.389967 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 546/1116] 10.222.0.93 () {56 vars in 1186 bytes} [Tue Jul 26 14:40:10 2022] GET /identity/v3/projects/37b0bc0010c04c6bbdd5500d8e4b8f07 => generated 311 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:40:10.398021 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fff69cc-80c2-4d6b-b6ae-e4a7c2aece66 None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:10.509407 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fff69cc-80c2-4d6b-b6ae-e4a7c2aece66 None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:10.544506 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127cb23a-0a63-45c3-9572-b7f2b92c2ced None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:10.545133 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127cb23a-0a63-45c3-9572-b7f2b92c2ced None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:10.545417 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127cb23a-0a63-45c3-9572-b7f2b92c2ced None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:10.545695 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127cb23a-0a63-45c3-9572-b7f2b92c2ced None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:10.546516 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127cb23a-0a63-45c3-9572-b7f2b92c2ced None admin] RBAC: Adding query filter params (role.id=ef1a806f8d774452a6536b57a4670ceb, scope.project.id=37b0bc0010c04c6bbdd5500d8e4b8f07, user.id=f8cb41b2e40b4dff8dc397926d0f1f38) {{(pid=87056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:40:10.546901 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127cb23a-0a63-45c3-9572-b7f2b92c2ced None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:10.548349 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127cb23a-0a63-45c3-9572-b7f2b92c2ced None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:10.554925 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 571/1117] 10.222.0.93 () {56 vars in 1374 bytes} [Tue Jul 26 14:40:10 2022] GET /identity/v3/role_assignments?user.id=f8cb41b2e40b4dff8dc397926d0f1f38&scope.project.id=37b0bc0010c04c6bbdd5500d8e4b8f07&role.id=ef1a806f8d774452a6536b57a4670ceb => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:40:12.708308 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4396784-666f-4483-a0d5-84b8fcbb1eb1 None None] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:12.709122 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4396784-666f-4483-a0d5-84b8fcbb1eb1 None None] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:12.709122 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4396784-666f-4483-a0d5-84b8fcbb1eb1 None None] PATH_INFO: `/` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:12.710518 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 547/1118] 10.222.0.93 () {54 vars in 926 bytes} [Tue Jul 26 14:40:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:40:12.717652 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ea4f0e-515c-4452-85e6-64428bec5ccc None None] REQUEST_METHOD: `POST` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:12.718320 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ea4f0e-515c-4452-85e6-64428bec5ccc None None] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:12.718320 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ea4f0e-515c-4452-85e6-64428bec5ccc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:12.740689 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.auth.core [None req-93ea4f0e-515c-4452-85e6-64428bec5ccc None None] MFA Rules not processed for user `e5ef88cc058f425b882bcb87a1e1e75c`. Rule list: `[]` (Enabled: `True`). {{(pid=87056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:40:12.742110 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.fernet_utils [None req-93ea4f0e-515c-4452-85e6-64428bec5ccc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:40:12.804294 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:12.834064 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 572/1119] 10.222.0.93 () {58 vars in 1023 bytes} [Tue Jul 26 14:40:12 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 26 14:40:12.862078 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4396784-666f-4483-a0d5-84b8fcbb1eb1 None None] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:12.996836 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4396784-666f-4483-a0d5-84b8fcbb1eb1 None None] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:13.045192 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2235f091-72f1-409e-8d11-6edaaeb35629 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:13.045884 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2235f091-72f1-409e-8d11-6edaaeb35629 None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:13.046169 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2235f091-72f1-409e-8d11-6edaaeb35629 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:13.046494 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2235f091-72f1-409e-8d11-6edaaeb35629 None admin] PATH_INFO: `/v3/roles/ef1a806f8d774452a6536b57a4670ceb` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:13.048308 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2235f091-72f1-409e-8d11-6edaaeb35629 None admin] RBAC: Authorizing `identity:get_role(role_id=ef1a806f8d774452a6536b57a4670ceb)` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:13.050780 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2235f091-72f1-409e-8d11-6edaaeb35629 None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:13.052411 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 548/1120] 10.222.0.93 () {56 vars in 1177 bytes} [Tue Jul 26 14:40:12 2022] GET /identity/v3/roles/ef1a806f8d774452a6536b57a4670ceb => generated 223 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:40:13.061806 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ea4f0e-515c-4452-85e6-64428bec5ccc None None] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:13.191996 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ea4f0e-515c-4452-85e6-64428bec5ccc None None] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:13.233775 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff91b199-79ab-466d-a0f5-17c12bc1dad1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:13.234476 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff91b199-79ab-466d-a0f5-17c12bc1dad1 None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:13.234763 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff91b199-79ab-466d-a0f5-17c12bc1dad1 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:13.235044 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff91b199-79ab-466d-a0f5-17c12bc1dad1 None admin] PATH_INFO: `/v3/users/f8cb41b2e40b4dff8dc397926d0f1f38` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:13.236630 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff91b199-79ab-466d-a0f5-17c12bc1dad1 None admin] RBAC: Authorizing `identity:get_user(user_id=f8cb41b2e40b4dff8dc397926d0f1f38)` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:13.238285 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff91b199-79ab-466d-a0f5-17c12bc1dad1 None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:13.240123 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 573/1121] 10.222.0.93 () {56 vars in 1177 bytes} [Tue Jul 26 14:40:13 2022] GET /identity/v3/users/f8cb41b2e40b4dff8dc397926d0f1f38 => generated 286 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:40:13.247203 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2235f091-72f1-409e-8d11-6edaaeb35629 None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:13.339481 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:13.380238 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2235f091-72f1-409e-8d11-6edaaeb35629 None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:13.425506 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff66a4d3-ab01-420f-9da7-3a7b8f555a93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:13.426304 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff66a4d3-ab01-420f-9da7-3a7b8f555a93 None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:13.426629 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff66a4d3-ab01-420f-9da7-3a7b8f555a93 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:13.426948 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff66a4d3-ab01-420f-9da7-3a7b8f555a93 None admin] PATH_INFO: `/v3/projects/37b0bc0010c04c6bbdd5500d8e4b8f07` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:13.428413 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff66a4d3-ab01-420f-9da7-3a7b8f555a93 None admin] RBAC: Authorizing `identity:get_project(project_id=37b0bc0010c04c6bbdd5500d8e4b8f07)` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:13.430190 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff66a4d3-ab01-420f-9da7-3a7b8f555a93 None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:13.432443 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 549/1122] 10.222.0.93 () {56 vars in 1186 bytes} [Tue Jul 26 14:40:13 2022] GET /identity/v3/projects/37b0bc0010c04c6bbdd5500d8e4b8f07 => generated 311 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:40:13.439637 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff91b199-79ab-466d-a0f5-17c12bc1dad1 None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:13.503493 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:13.566083 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff91b199-79ab-466d-a0f5-17c12bc1dad1 None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:13.607982 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed21cebf-9bb5-4242-acef-b9fc5a6dba81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:13.608741 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed21cebf-9bb5-4242-acef-b9fc5a6dba81 None admin] REQUEST_METHOD: `PUT` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:13.609028 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed21cebf-9bb5-4242-acef-b9fc5a6dba81 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:13.609312 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed21cebf-9bb5-4242-acef-b9fc5a6dba81 None admin] PATH_INFO: `/v3/projects/37b0bc0010c04c6bbdd5500d8e4b8f07/users/f8cb41b2e40b4dff8dc397926d0f1f38/roles/ef1a806f8d774452a6536b57a4670ceb` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:13.611799 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed21cebf-9bb5-4242-acef-b9fc5a6dba81 None admin] RBAC: Authorizing `identity:create_grant(project_id=37b0bc0010c04c6bbdd5500d8e4b8f07, user_id=f8cb41b2e40b4dff8dc397926d0f1f38, role_id=ef1a806f8d774452a6536b57a4670ceb)` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:13.613296 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed21cebf-9bb5-4242-acef-b9fc5a6dba81 None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:13.695369 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 574/1123] 10.222.0.93 () {58 vars in 1439 bytes} [Tue Jul 26 14:40:13 2022] PUT /identity/v3/projects/37b0bc0010c04c6bbdd5500d8e4b8f07/users/f8cb41b2e40b4dff8dc397926d0f1f38/roles/ef1a806f8d774452a6536b57a4670ceb => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 14:40:15.857942 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407884e5-3d8c-4eef-b9c4-6e4d622f751a None None] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:15.858560 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407884e5-3d8c-4eef-b9c4-6e4d622f751a None None] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:15.858560 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407884e5-3d8c-4eef-b9c4-6e4d622f751a None None] PATH_INFO: `/` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:15.860046 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 550/1124] 10.222.0.93 () {54 vars in 926 bytes} [Tue Jul 26 14:40:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 14:40:15.866700 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9500a34-3f6d-4d7b-b2dd-1aedbe9ffac1 None None] REQUEST_METHOD: `POST` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:15.867251 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9500a34-3f6d-4d7b-b2dd-1aedbe9ffac1 None None] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:15.867251 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9500a34-3f6d-4d7b-b2dd-1aedbe9ffac1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:15.887491 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.auth.core [None req-d9500a34-3f6d-4d7b-b2dd-1aedbe9ffac1 None None] MFA Rules not processed for user `e5ef88cc058f425b882bcb87a1e1e75c`. Rule list: `[]` (Enabled: `True`). {{(pid=87056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:40:15.888774 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.fernet_utils [None req-d9500a34-3f6d-4d7b-b2dd-1aedbe9ffac1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:40:15.990057 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 575/1125] 10.222.0.93 () {58 vars in 1023 bytes} [Tue Jul 26 14:40:15 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 26 14:40:16.014403 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407884e5-3d8c-4eef-b9c4-6e4d622f751a None None] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:16.147736 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407884e5-3d8c-4eef-b9c4-6e4d622f751a None None] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:16.195094 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0051a9-3db5-4ad6-83c8-4ffc4a01f712 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:16.195752 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0051a9-3db5-4ad6-83c8-4ffc4a01f712 None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:16.196033 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0051a9-3db5-4ad6-83c8-4ffc4a01f712 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:16.196306 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0051a9-3db5-4ad6-83c8-4ffc4a01f712 None admin] PATH_INFO: `/v3/roles/ef1a806f8d774452a6536b57a4670ceb` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:16.197854 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0051a9-3db5-4ad6-83c8-4ffc4a01f712 None admin] RBAC: Authorizing `identity:get_role(role_id=ef1a806f8d774452a6536b57a4670ceb)` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:16.199298 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0051a9-3db5-4ad6-83c8-4ffc4a01f712 None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:16.200721 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 551/1126] 10.222.0.93 () {56 vars in 1177 bytes} [Tue Jul 26 14:40:16 2022] GET /identity/v3/roles/ef1a806f8d774452a6536b57a4670ceb => generated 223 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:40:16.208273 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9500a34-3f6d-4d7b-b2dd-1aedbe9ffac1 None None] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:16.260774 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:16.338605 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9500a34-3f6d-4d7b-b2dd-1aedbe9ffac1 None None] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:16.380264 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d287b65-e8d1-4581-a264-96f183f25e54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:16.380985 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d287b65-e8d1-4581-a264-96f183f25e54 None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:16.381311 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d287b65-e8d1-4581-a264-96f183f25e54 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:16.381633 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d287b65-e8d1-4581-a264-96f183f25e54 None admin] PATH_INFO: `/v3/users/f8cb41b2e40b4dff8dc397926d0f1f38` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:16.382991 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d287b65-e8d1-4581-a264-96f183f25e54 None admin] RBAC: Authorizing `identity:get_user(user_id=f8cb41b2e40b4dff8dc397926d0f1f38)` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:16.384506 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d287b65-e8d1-4581-a264-96f183f25e54 None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:16.386226 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 576/1127] 10.222.0.93 () {56 vars in 1177 bytes} [Tue Jul 26 14:40:16 2022] GET /identity/v3/users/f8cb41b2e40b4dff8dc397926d0f1f38 => generated 286 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:40:16.392323 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0051a9-3db5-4ad6-83c8-4ffc4a01f712 None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:16.396942 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:16.527875 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0051a9-3db5-4ad6-83c8-4ffc4a01f712 None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:16.583161 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e5ee70-2d49-40b9-af79-e0d0eb87a536 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:16.584089 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e5ee70-2d49-40b9-af79-e0d0eb87a536 None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:16.584415 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e5ee70-2d49-40b9-af79-e0d0eb87a536 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:16.584689 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e5ee70-2d49-40b9-af79-e0d0eb87a536 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:16.685386 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e5ee70-2d49-40b9-af79-e0d0eb87a536 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:16.688027 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e5ee70-2d49-40b9-af79-e0d0eb87a536 None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:16.692401 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:16.807016 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 552/1128] 10.222.0.93 () {58 vars in 1282 bytes} [Tue Jul 26 14:40:16 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 26 14:40:16.815926 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d287b65-e8d1-4581-a264-96f183f25e54 None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:16.936039 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d287b65-e8d1-4581-a264-96f183f25e54 None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:16.947472 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:16.991356 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcda4086-49dc-4013-aaf2-fbab74934831 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:16.992475 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcda4086-49dc-4013-aaf2-fbab74934831 None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:16.992967 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcda4086-49dc-4013-aaf2-fbab74934831 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:16.993468 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcda4086-49dc-4013-aaf2-fbab74934831 None admin] PATH_INFO: `/v3/projects/37b0bc0010c04c6bbdd5500d8e4b8f07` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:16.995845 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcda4086-49dc-4013-aaf2-fbab74934831 None admin] RBAC: Authorizing `identity:get_project(project_id=37b0bc0010c04c6bbdd5500d8e4b8f07)` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:16.998657 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcda4086-49dc-4013-aaf2-fbab74934831 None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:17.002032 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 577/1129] 10.222.0.93 () {56 vars in 1186 bytes} [Tue Jul 26 14:40:16 2022] GET /identity/v3/projects/37b0bc0010c04c6bbdd5500d8e4b8f07 => generated 311 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:40:17.010109 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e5ee70-2d49-40b9-af79-e0d0eb87a536 None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:17.174980 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e5ee70-2d49-40b9-af79-e0d0eb87a536 None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:17.177956 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:17.217504 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f499440-2239-414b-b7ff-7322a1c638a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:17.218150 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f499440-2239-414b-b7ff-7322a1c638a1 None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:17.218461 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f499440-2239-414b-b7ff-7322a1c638a1 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:17.218743 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f499440-2239-414b-b7ff-7322a1c638a1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:17.219567 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f499440-2239-414b-b7ff-7322a1c638a1 None admin] RBAC: Adding query filter params (role.id=ef1a806f8d774452a6536b57a4670ceb, scope.project.id=37b0bc0010c04c6bbdd5500d8e4b8f07, user.id=f8cb41b2e40b4dff8dc397926d0f1f38) {{(pid=87055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:40:17.219899 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f499440-2239-414b-b7ff-7322a1c638a1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:17.221985 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f499440-2239-414b-b7ff-7322a1c638a1 None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:17.228877 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 553/1130] 10.222.0.93 () {56 vars in 1374 bytes} [Tue Jul 26 14:40:17 2022] GET /identity/v3/role_assignments?user.id=f8cb41b2e40b4dff8dc397926d0f1f38&scope.project.id=37b0bc0010c04c6bbdd5500d8e4b8f07&role.id=ef1a806f8d774452a6536b57a4670ceb => generated 608 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:40:19.554725 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecfe9b9-0718-47a6-abaf-c19cfda37e3e None None] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:19.555327 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecfe9b9-0718-47a6-abaf-c19cfda37e3e None None] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:19.555327 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecfe9b9-0718-47a6-abaf-c19cfda37e3e None None] PATH_INFO: `/` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:19.556670 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 578/1131] 10.222.0.93 () {54 vars in 926 bytes} [Tue Jul 26 14:40:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 14:40:19.562836 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ecbb30-d1be-49f0-90cb-744ed59d1d4c None None] REQUEST_METHOD: `POST` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:19.563403 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ecbb30-d1be-49f0-90cb-744ed59d1d4c None None] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:19.563403 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ecbb30-d1be-49f0-90cb-744ed59d1d4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:19.586940 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.auth.core [None req-24ecbb30-d1be-49f0-90cb-744ed59d1d4c None None] MFA Rules not processed for user `e5ef88cc058f425b882bcb87a1e1e75c`. Rule list: `[]` (Enabled: `True`). {{(pid=87055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:40:19.588229 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.fernet_utils [None req-24ecbb30-d1be-49f0-90cb-744ed59d1d4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:40:19.671589 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 554/1132] 10.222.0.93 () {58 vars in 1023 bytes} [Tue Jul 26 14:40:19 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 14:40:19.698426 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecfe9b9-0718-47a6-abaf-c19cfda37e3e None None] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:19.854715 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecfe9b9-0718-47a6-abaf-c19cfda37e3e None None] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:19.897095 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e192e2-76a5-4253-bb99-8ac774a53ab3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:19.897770 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e192e2-76a5-4253-bb99-8ac774a53ab3 None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:19.898052 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e192e2-76a5-4253-bb99-8ac774a53ab3 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:19.898362 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e192e2-76a5-4253-bb99-8ac774a53ab3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:19.899655 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e192e2-76a5-4253-bb99-8ac774a53ab3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:19.901123 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e192e2-76a5-4253-bb99-8ac774a53ab3 None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:19.903055 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 579/1133] 10.222.0.93 () {56 vars in 1108 bytes} [Tue Jul 26 14:40:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:40:19.910644 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ecbb30-d1be-49f0-90cb-744ed59d1d4c None None] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:20.029054 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:20.034107 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ecbb30-d1be-49f0-90cb-744ed59d1d4c None None] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:20.070615 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc56641b-d86c-4c5e-aa56-3456e2f0d2fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:20.071248 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc56641b-d86c-4c5e-aa56-3456e2f0d2fb None admin] REQUEST_METHOD: `POST` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:20.071531 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc56641b-d86c-4c5e-aa56-3456e2f0d2fb None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:20.071811 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc56641b-d86c-4c5e-aa56-3456e2f0d2fb None admin] PATH_INFO: `/v3/projects` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:20.072507 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc56641b-d86c-4c5e-aa56-3456e2f0d2fb None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:20.074022 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc56641b-d86c-4c5e-aa56-3456e2f0d2fb None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:20.224289 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 555/1134] 10.222.0.93 () {60 vars in 1141 bytes} [Tue Jul 26 14:40:19 2022] POST /identity/v3/projects => generated 311 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 14:40:22.454514 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edda8d97-bd67-44e7-a97c-10ac31ea0167 None None] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:22.455212 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edda8d97-bd67-44e7-a97c-10ac31ea0167 None None] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:22.455212 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edda8d97-bd67-44e7-a97c-10ac31ea0167 None None] PATH_INFO: `/` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:22.456840 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 580/1135] 10.222.0.93 () {54 vars in 926 bytes} [Tue Jul 26 14:40:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:40:22.463165 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1991ad26-f071-40f1-a079-dc2d8f7b3d24 None None] REQUEST_METHOD: `POST` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:22.463961 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1991ad26-f071-40f1-a079-dc2d8f7b3d24 None None] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:22.463961 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1991ad26-f071-40f1-a079-dc2d8f7b3d24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:22.483507 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.auth.core [None req-1991ad26-f071-40f1-a079-dc2d8f7b3d24 None None] MFA Rules not processed for user `e5ef88cc058f425b882bcb87a1e1e75c`. Rule list: `[]` (Enabled: `True`). {{(pid=87055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:40:22.484755 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.fernet_utils [None req-1991ad26-f071-40f1-a079-dc2d8f7b3d24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:40:22.566883 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 556/1136] 10.222.0.93 () {58 vars in 1023 bytes} [Tue Jul 26 14:40:22 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 26 14:40:22.592231 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edda8d97-bd67-44e7-a97c-10ac31ea0167 None None] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:22.649661 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:22.718129 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edda8d97-bd67-44e7-a97c-10ac31ea0167 None None] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:22.760094 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e728ebd-4793-4e15-a032-180213330521 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:22.760760 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e728ebd-4793-4e15-a032-180213330521 None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:22.761048 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e728ebd-4793-4e15-a032-180213330521 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:22.761327 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e728ebd-4793-4e15-a032-180213330521 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:22.762640 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e728ebd-4793-4e15-a032-180213330521 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:22.764183 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e728ebd-4793-4e15-a032-180213330521 None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:22.765978 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 581/1137] 10.222.0.93 () {56 vars in 1108 bytes} [Tue Jul 26 14:40:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:40:22.773424 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1991ad26-f071-40f1-a079-dc2d8f7b3d24 None None] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:22.872941 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:22.897120 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1991ad26-f071-40f1-a079-dc2d8f7b3d24 None None] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:22.938578 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc1d15c-7c8e-41d3-8562-a6dbf19828df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:22.939264 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc1d15c-7c8e-41d3-8562-a6dbf19828df None admin] REQUEST_METHOD: `POST` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:22.940284 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc1d15c-7c8e-41d3-8562-a6dbf19828df None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:22.940837 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc1d15c-7c8e-41d3-8562-a6dbf19828df None admin] PATH_INFO: `/v3/users` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:22.941371 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc1d15c-7c8e-41d3-8562-a6dbf19828df None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:22.943012 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc1d15c-7c8e-41d3-8562-a6dbf19828df None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:23.068672 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 557/1138] 10.222.0.93 () {60 vars in 1132 bytes} [Tue Jul 26 14:40:22 2022] POST /identity/v3/users => generated 286 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 14:40:25.335630 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af29a2b-4a61-4386-a60d-a9b5e31e083a None None] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:25.336188 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af29a2b-4a61-4386-a60d-a9b5e31e083a None None] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:25.336590 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af29a2b-4a61-4386-a60d-a9b5e31e083a None None] PATH_INFO: `/` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:25.339184 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 582/1139] 10.222.0.93 () {54 vars in 926 bytes} [Tue Jul 26 14:40:25 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:40:25.346985 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600cc93e-af37-4fda-b5b5-06a745dd46ce None None] REQUEST_METHOD: `POST` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:25.347551 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600cc93e-af37-4fda-b5b5-06a745dd46ce None None] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:25.347551 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600cc93e-af37-4fda-b5b5-06a745dd46ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:25.369760 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.auth.core [None req-600cc93e-af37-4fda-b5b5-06a745dd46ce None None] MFA Rules not processed for user `e5ef88cc058f425b882bcb87a1e1e75c`. Rule list: `[]` (Enabled: `True`). {{(pid=87055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:40:25.371051 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.fernet_utils [None req-600cc93e-af37-4fda-b5b5-06a745dd46ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:40:25.454384 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 558/1140] 10.222.0.93 () {58 vars in 1023 bytes} [Tue Jul 26 14:40:25 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 26 14:40:25.477901 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af29a2b-4a61-4386-a60d-a9b5e31e083a None None] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:25.607413 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af29a2b-4a61-4386-a60d-a9b5e31e083a None None] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:25.624749 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:25.652542 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642c4797-963e-45ec-80d3-fcd05aeb8d50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:25.653378 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642c4797-963e-45ec-80d3-fcd05aeb8d50 None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:25.653781 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642c4797-963e-45ec-80d3-fcd05aeb8d50 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:25.654161 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642c4797-963e-45ec-80d3-fcd05aeb8d50 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:25.668474 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642c4797-963e-45ec-80d3-fcd05aeb8d50 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 14:40:25.673581 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application [None req-642c4797-963e-45ec-80d3-fcd05aeb8d50 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 14:40:25.673581 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:40:25.673581 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:40:25.673581 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:40:25.673581 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:40:25.673581 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:40:25.673581 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:40:25.673581 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:40:25.673581 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:40:25.673581 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:40:25.673581 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:40:25.673581 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:40:25.673581 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 14:40:25.673581 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 14:40:25.673581 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 14:40:25.673581 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 14:40:25.675373 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 14:40:25.675373 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 14:40:25.675373 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 14:40:25.675373 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 14:40:25.675373 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:40:25.675373 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:40:25.675373 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:40:25.675373 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:40:25.675373 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:40:25.675373 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:40:25.675373 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:40:25.675373 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application with Lock( Jul 26 14:40:25.675373 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:40:25.675373 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:40:25.675373 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:40:25.675373 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:40:25.676565 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:40:25.676565 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:40:25.676565 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:40:25.676565 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:40:25.676565 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 14:40:25.676565 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 14:40:25.676565 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 14:40:25.676565 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 14:40:25.676565 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 14:40:25.676565 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 14:40:25.676565 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 14:40:25.676565 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Jul 26 14:40:25.676565 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 583/1141] 10.222.0.93 () {56 vars in 1096 bytes} [Tue Jul 26 14:40:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:40:25.683183 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600cc93e-af37-4fda-b5b5-06a745dd46ce None None] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:25.767302 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:25.817026 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600cc93e-af37-4fda-b5b5-06a745dd46ce None None] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:25.863759 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e964c1-a202-4595-b353-2cf65328f68a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:25.864285 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e964c1-a202-4595-b353-2cf65328f68a None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:25.864564 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e964c1-a202-4595-b353-2cf65328f68a None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:25.864837 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e964c1-a202-4595-b353-2cf65328f68a None admin] PATH_INFO: `/v3/roles` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:25.865567 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e964c1-a202-4595-b353-2cf65328f68a None admin] RBAC: Adding query filter params (name=admin) {{(pid=87055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:40:25.865953 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e964c1-a202-4595-b353-2cf65328f68a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:25.867746 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e964c1-a202-4595-b353-2cf65328f68a None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:25.878784 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 559/1142] 10.222.0.93 () {56 vars in 1099 bytes} [Tue Jul 26 14:40:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:40:25.885252 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642c4797-963e-45ec-80d3-fcd05aeb8d50 None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:26.003331 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642c4797-963e-45ec-80d3-fcd05aeb8d50 None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:26.044170 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b53a6e-575e-4016-b65b-ac01bb8766bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:26.044838 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b53a6e-575e-4016-b65b-ac01bb8766bc None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:26.045120 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b53a6e-575e-4016-b65b-ac01bb8766bc None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:26.045397 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b53a6e-575e-4016-b65b-ac01bb8766bc None admin] PATH_INFO: `/v3/users/f71a1854231946e6b515fe7ba54bb014` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:26.071939 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b53a6e-575e-4016-b65b-ac01bb8766bc None admin] RBAC: Authorizing `identity:get_user(user_id=f71a1854231946e6b515fe7ba54bb014)` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:26.073501 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b53a6e-575e-4016-b65b-ac01bb8766bc None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:26.075431 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 584/1143] 10.222.0.93 () {56 vars in 1177 bytes} [Tue Jul 26 14:40:25 2022] GET /identity/v3/users/f71a1854231946e6b515fe7ba54bb014 => generated 286 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:40:26.084295 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e964c1-a202-4595-b353-2cf65328f68a None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:26.250788 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e964c1-a202-4595-b353-2cf65328f68a None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:26.284021 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:26.293060 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12aeac90-6628-4bf1-a86d-bc6050f44376 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:26.293850 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12aeac90-6628-4bf1-a86d-bc6050f44376 None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:26.294178 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12aeac90-6628-4bf1-a86d-bc6050f44376 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:26.294551 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12aeac90-6628-4bf1-a86d-bc6050f44376 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:26.376013 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12aeac90-6628-4bf1-a86d-bc6050f44376 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:26.377620 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12aeac90-6628-4bf1-a86d-bc6050f44376 None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:26.519105 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 560/1144] 10.222.0.93 () {58 vars in 1282 bytes} [Tue Jul 26 14:40:26 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 26 14:40:26.525530 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b53a6e-575e-4016-b65b-ac01bb8766bc None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:26.560394 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:26.647990 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b53a6e-575e-4016-b65b-ac01bb8766bc None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:26.693113 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0ae47c-dbac-4a83-9261-6cd69fd530a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:26.694226 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0ae47c-dbac-4a83-9261-6cd69fd530a1 None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:26.694754 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0ae47c-dbac-4a83-9261-6cd69fd530a1 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:26.695245 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0ae47c-dbac-4a83-9261-6cd69fd530a1 None admin] PATH_INFO: `/v3/projects/0c5098ab70104c758e4fe7c86208551a` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:26.697297 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0ae47c-dbac-4a83-9261-6cd69fd530a1 None admin] RBAC: Authorizing `identity:get_project(project_id=0c5098ab70104c758e4fe7c86208551a)` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:26.700028 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0ae47c-dbac-4a83-9261-6cd69fd530a1 None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:26.703259 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 585/1145] 10.222.0.93 () {56 vars in 1186 bytes} [Tue Jul 26 14:40:26 2022] GET /identity/v3/projects/0c5098ab70104c758e4fe7c86208551a => generated 311 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:40:26.711217 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12aeac90-6628-4bf1-a86d-bc6050f44376 None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:26.760400 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:26.849205 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12aeac90-6628-4bf1-a86d-bc6050f44376 None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:26.889992 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f350cb81-cc43-4385-a6cf-0ca3f3f542d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:26.890741 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f350cb81-cc43-4385-a6cf-0ca3f3f542d3 None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:26.891025 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f350cb81-cc43-4385-a6cf-0ca3f3f542d3 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:26.891302 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f350cb81-cc43-4385-a6cf-0ca3f3f542d3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:26.892119 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f350cb81-cc43-4385-a6cf-0ca3f3f542d3 None admin] RBAC: Adding query filter params (role.id=94e105ff8ee4486abd501415cc05ba38, scope.project.id=0c5098ab70104c758e4fe7c86208551a, user.id=f71a1854231946e6b515fe7ba54bb014) {{(pid=87055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:40:26.892977 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f350cb81-cc43-4385-a6cf-0ca3f3f542d3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:26.894546 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f350cb81-cc43-4385-a6cf-0ca3f3f542d3 None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:26.901144 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 561/1146] 10.222.0.93 () {56 vars in 1374 bytes} [Tue Jul 26 14:40:26 2022] GET /identity/v3/role_assignments?user.id=f71a1854231946e6b515fe7ba54bb014&scope.project.id=0c5098ab70104c758e4fe7c86208551a&role.id=94e105ff8ee4486abd501415cc05ba38 => generated 259 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:40:29.023043 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b366928-e001-41e5-b643-b7169de468cb None None] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:29.023717 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b366928-e001-41e5-b643-b7169de468cb None None] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:29.023717 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b366928-e001-41e5-b643-b7169de468cb None None] PATH_INFO: `/` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:29.025486 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 586/1147] 10.222.0.93 () {54 vars in 926 bytes} [Tue Jul 26 14:40:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:40:29.033388 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9670a328-064f-4814-a35e-2a473bdc1cdb None None] REQUEST_METHOD: `POST` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:29.034004 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9670a328-064f-4814-a35e-2a473bdc1cdb None None] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:29.034170 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9670a328-064f-4814-a35e-2a473bdc1cdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:29.063910 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.auth.core [None req-9670a328-064f-4814-a35e-2a473bdc1cdb None None] MFA Rules not processed for user `e5ef88cc058f425b882bcb87a1e1e75c`. Rule list: `[]` (Enabled: `True`). {{(pid=87055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:40:29.065961 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.fernet_utils [None req-9670a328-064f-4814-a35e-2a473bdc1cdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:40:29.144553 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 562/1148] 10.222.0.93 () {58 vars in 1023 bytes} [Tue Jul 26 14:40:29 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 14:40:29.168207 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b366928-e001-41e5-b643-b7169de468cb None None] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:29.280328 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:29.286407 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b366928-e001-41e5-b643-b7169de468cb None None] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:29.325889 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9594f1de-2f48-4984-b91b-4388bf213560 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:29.326845 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9594f1de-2f48-4984-b91b-4388bf213560 None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:29.327537 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9594f1de-2f48-4984-b91b-4388bf213560 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:29.327911 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9594f1de-2f48-4984-b91b-4388bf213560 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:29.340642 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9594f1de-2f48-4984-b91b-4388bf213560 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 14:40:29.345804 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application [None req-9594f1de-2f48-4984-b91b-4388bf213560 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 14:40:29.345804 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:40:29.345804 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:40:29.345804 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:40:29.345804 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:40:29.345804 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:40:29.345804 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:40:29.345804 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:40:29.345804 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:40:29.345804 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:40:29.345804 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:40:29.345804 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:40:29.345804 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 14:40:29.345804 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 14:40:29.345804 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 14:40:29.345804 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 14:40:29.347694 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 14:40:29.347694 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 14:40:29.347694 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 14:40:29.347694 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 14:40:29.347694 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:40:29.347694 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:40:29.347694 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:40:29.347694 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:40:29.347694 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:40:29.347694 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:40:29.347694 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:40:29.347694 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application with Lock( Jul 26 14:40:29.347694 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:40:29.347694 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:40:29.347694 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:40:29.347694 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:40:29.349416 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:40:29.349416 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:40:29.349416 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:40:29.349416 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:40:29.349416 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 14:40:29.349416 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 14:40:29.349416 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 14:40:29.349416 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 14:40:29.349416 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 14:40:29.349416 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 14:40:29.349416 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 14:40:29.349416 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Jul 26 14:40:29.349416 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 587/1149] 10.222.0.93 () {56 vars in 1096 bytes} [Tue Jul 26 14:40:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 14:40:29.355152 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9670a328-064f-4814-a35e-2a473bdc1cdb None None] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:29.382724 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:29.468051 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9670a328-064f-4814-a35e-2a473bdc1cdb None None] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:29.506742 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a80ad3-cbe5-4e7d-bbd2-9db953f6f082 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:29.507351 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a80ad3-cbe5-4e7d-bbd2-9db953f6f082 None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:29.507636 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a80ad3-cbe5-4e7d-bbd2-9db953f6f082 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:29.507916 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a80ad3-cbe5-4e7d-bbd2-9db953f6f082 None admin] PATH_INFO: `/v3/roles` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:29.508652 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a80ad3-cbe5-4e7d-bbd2-9db953f6f082 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:40:29.508960 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a80ad3-cbe5-4e7d-bbd2-9db953f6f082 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:29.510385 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a80ad3-cbe5-4e7d-bbd2-9db953f6f082 None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:29.520205 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 563/1150] 10.222.0.93 () {56 vars in 1099 bytes} [Tue Jul 26 14:40:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:40:29.530124 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9594f1de-2f48-4984-b91b-4388bf213560 None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:29.671091 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9594f1de-2f48-4984-b91b-4388bf213560 None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:29.708391 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc173d45-2b3b-4e56-a697-4f2c5c11ccfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:29.709050 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc173d45-2b3b-4e56-a697-4f2c5c11ccfe None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:29.709329 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc173d45-2b3b-4e56-a697-4f2c5c11ccfe None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:29.709603 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc173d45-2b3b-4e56-a697-4f2c5c11ccfe None admin] PATH_INFO: `/v3/users/f71a1854231946e6b515fe7ba54bb014` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:29.710839 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc173d45-2b3b-4e56-a697-4f2c5c11ccfe None admin] RBAC: Authorizing `identity:get_user(user_id=f71a1854231946e6b515fe7ba54bb014)` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:29.712302 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc173d45-2b3b-4e56-a697-4f2c5c11ccfe None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:29.713949 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 588/1151] 10.222.0.93 () {56 vars in 1177 bytes} [Tue Jul 26 14:40:29 2022] GET /identity/v3/users/f71a1854231946e6b515fe7ba54bb014 => generated 286 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:40:29.720193 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a80ad3-cbe5-4e7d-bbd2-9db953f6f082 None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:29.816223 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:29.834223 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a80ad3-cbe5-4e7d-bbd2-9db953f6f082 None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:29.872561 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f50da30-8f9a-4598-b9ae-9460e7f04380 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:29.873395 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f50da30-8f9a-4598-b9ae-9460e7f04380 None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:29.873769 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f50da30-8f9a-4598-b9ae-9460e7f04380 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:29.874143 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f50da30-8f9a-4598-b9ae-9460e7f04380 None admin] PATH_INFO: `/v3/projects/0c5098ab70104c758e4fe7c86208551a` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:29.875573 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f50da30-8f9a-4598-b9ae-9460e7f04380 None admin] RBAC: Authorizing `identity:get_project(project_id=0c5098ab70104c758e4fe7c86208551a)` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:29.877175 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f50da30-8f9a-4598-b9ae-9460e7f04380 None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:29.878998 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 564/1152] 10.222.0.93 () {56 vars in 1186 bytes} [Tue Jul 26 14:40:29 2022] GET /identity/v3/projects/0c5098ab70104c758e4fe7c86208551a => generated 311 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:40:29.888723 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc173d45-2b3b-4e56-a697-4f2c5c11ccfe None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:29.928710 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:30.017695 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc173d45-2b3b-4e56-a697-4f2c5c11ccfe None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:30.058558 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829bcdf1-6599-4298-bf67-7b1a201383a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:30.059259 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829bcdf1-6599-4298-bf67-7b1a201383a9 None admin] REQUEST_METHOD: `PUT` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:30.059517 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829bcdf1-6599-4298-bf67-7b1a201383a9 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:30.059798 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829bcdf1-6599-4298-bf67-7b1a201383a9 None admin] PATH_INFO: `/v3/projects/0c5098ab70104c758e4fe7c86208551a/users/f71a1854231946e6b515fe7ba54bb014/roles/94e105ff8ee4486abd501415cc05ba38` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:30.061802 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829bcdf1-6599-4298-bf67-7b1a201383a9 None admin] RBAC: Authorizing `identity:create_grant(project_id=0c5098ab70104c758e4fe7c86208551a, user_id=f71a1854231946e6b515fe7ba54bb014, role_id=94e105ff8ee4486abd501415cc05ba38)` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:30.063441 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829bcdf1-6599-4298-bf67-7b1a201383a9 None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:30.170611 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 589/1153] 10.222.0.93 () {58 vars in 1439 bytes} [Tue Jul 26 14:40:29 2022] PUT /identity/v3/projects/0c5098ab70104c758e4fe7c86208551a/users/f71a1854231946e6b515fe7ba54bb014/roles/94e105ff8ee4486abd501415cc05ba38 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 14:40:32.287097 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f227710-eb5c-473e-9886-9734c71f02c6 None None] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:32.287697 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f227710-eb5c-473e-9886-9734c71f02c6 None None] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:32.287697 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f227710-eb5c-473e-9886-9734c71f02c6 None None] PATH_INFO: `/` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:32.289054 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 565/1154] 10.222.0.93 () {54 vars in 926 bytes} [Tue Jul 26 14:40:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:40:32.295273 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8cc205-d029-4360-9c76-76c585ff9e84 None None] REQUEST_METHOD: `POST` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:32.296085 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8cc205-d029-4360-9c76-76c585ff9e84 None None] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:32.296085 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8cc205-d029-4360-9c76-76c585ff9e84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:32.316296 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.auth.core [None req-1f8cc205-d029-4360-9c76-76c585ff9e84 None None] MFA Rules not processed for user `e5ef88cc058f425b882bcb87a1e1e75c`. Rule list: `[]` (Enabled: `True`). {{(pid=87056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:40:32.317516 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.fernet_utils [None req-1f8cc205-d029-4360-9c76-76c585ff9e84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:40:32.393733 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 590/1155] 10.222.0.93 () {58 vars in 1023 bytes} [Tue Jul 26 14:40:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 26 14:40:32.418038 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f227710-eb5c-473e-9886-9734c71f02c6 None None] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:32.539397 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f227710-eb5c-473e-9886-9734c71f02c6 None None] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:32.578111 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956b8754-b755-41c7-87a9-b316ab944599 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:32.578800 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956b8754-b755-41c7-87a9-b316ab944599 None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:32.579083 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956b8754-b755-41c7-87a9-b316ab944599 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:32.579363 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956b8754-b755-41c7-87a9-b316ab944599 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:32.591335 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956b8754-b755-41c7-87a9-b316ab944599 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 14:40:32.597039 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application [None req-956b8754-b755-41c7-87a9-b316ab944599 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 14:40:32.597039 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:40:32.597039 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:40:32.597039 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:40:32.597039 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:40:32.597039 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:40:32.597039 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:40:32.597039 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:40:32.597039 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:40:32.597039 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:40:32.597039 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:40:32.597039 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:40:32.597039 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 14:40:32.597039 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 14:40:32.597039 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 14:40:32.597039 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 14:40:32.598864 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 14:40:32.598864 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 14:40:32.598864 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 14:40:32.598864 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 14:40:32.598864 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:40:32.598864 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:40:32.598864 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:40:32.598864 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:40:32.598864 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:40:32.598864 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:40:32.598864 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:40:32.598864 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application with Lock( Jul 26 14:40:32.598864 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:40:32.598864 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:40:32.598864 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:40:32.598864 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:40:32.600519 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:40:32.600519 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:40:32.600519 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:40:32.600519 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:40:32.600519 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 14:40:32.600519 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 14:40:32.600519 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 14:40:32.600519 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 14:40:32.600519 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 14:40:32.600519 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 14:40:32.600519 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 14:40:32.600519 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Jul 26 14:40:32.600519 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 566/1156] 10.222.0.93 () {56 vars in 1096 bytes} [Tue Jul 26 14:40:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 14:40:32.606157 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8cc205-d029-4360-9c76-76c585ff9e84 None None] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:32.627566 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:32.731755 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8cc205-d029-4360-9c76-76c585ff9e84 None None] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:32.774990 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484cc5ae-c848-463f-8b70-5d0b071c72d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:32.775656 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484cc5ae-c848-463f-8b70-5d0b071c72d1 None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:32.775980 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484cc5ae-c848-463f-8b70-5d0b071c72d1 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:32.776263 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484cc5ae-c848-463f-8b70-5d0b071c72d1 None admin] PATH_INFO: `/v3/roles` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:32.777016 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484cc5ae-c848-463f-8b70-5d0b071c72d1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:40:32.777330 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484cc5ae-c848-463f-8b70-5d0b071c72d1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:32.778819 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484cc5ae-c848-463f-8b70-5d0b071c72d1 None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:32.789559 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 591/1157] 10.222.0.93 () {56 vars in 1099 bytes} [Tue Jul 26 14:40:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:40:32.799957 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956b8754-b755-41c7-87a9-b316ab944599 None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:32.828436 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:32.980480 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956b8754-b755-41c7-87a9-b316ab944599 None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:33.019063 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb2f2f6-c55c-4328-94a1-896dd7e9891d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:33.019724 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb2f2f6-c55c-4328-94a1-896dd7e9891d None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:33.020006 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb2f2f6-c55c-4328-94a1-896dd7e9891d None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:33.020284 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb2f2f6-c55c-4328-94a1-896dd7e9891d None admin] PATH_INFO: `/v3/users/f71a1854231946e6b515fe7ba54bb014` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:33.021532 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb2f2f6-c55c-4328-94a1-896dd7e9891d None admin] RBAC: Authorizing `identity:get_user(user_id=f71a1854231946e6b515fe7ba54bb014)` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:33.023044 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb2f2f6-c55c-4328-94a1-896dd7e9891d None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:33.024739 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 567/1158] 10.222.0.93 () {56 vars in 1177 bytes} [Tue Jul 26 14:40:32 2022] GET /identity/v3/users/f71a1854231946e6b515fe7ba54bb014 => generated 286 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:40:33.030945 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484cc5ae-c848-463f-8b70-5d0b071c72d1 None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:33.140304 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:33.167572 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484cc5ae-c848-463f-8b70-5d0b071c72d1 None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:33.207706 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f926ec48-7776-494c-9857-fb1b93e3eb72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:33.208339 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f926ec48-7776-494c-9857-fb1b93e3eb72 None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:33.208613 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f926ec48-7776-494c-9857-fb1b93e3eb72 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:33.208884 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f926ec48-7776-494c-9857-fb1b93e3eb72 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:33.287884 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f926ec48-7776-494c-9857-fb1b93e3eb72 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:33.289456 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f926ec48-7776-494c-9857-fb1b93e3eb72 None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:33.382577 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:33.408286 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 592/1159] 10.222.0.93 () {58 vars in 1282 bytes} [Tue Jul 26 14:40:33 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 26 14:40:33.414212 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb2f2f6-c55c-4328-94a1-896dd7e9891d None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:33.508778 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:33.530050 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb2f2f6-c55c-4328-94a1-896dd7e9891d None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:33.569344 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06117f2-2909-41a3-adee-d38c3ae9df7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:33.570011 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06117f2-2909-41a3-adee-d38c3ae9df7b None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:33.570319 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06117f2-2909-41a3-adee-d38c3ae9df7b None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:33.570601 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06117f2-2909-41a3-adee-d38c3ae9df7b None admin] PATH_INFO: `/v3/projects/0c5098ab70104c758e4fe7c86208551a` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:33.571868 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06117f2-2909-41a3-adee-d38c3ae9df7b None admin] RBAC: Authorizing `identity:get_project(project_id=0c5098ab70104c758e4fe7c86208551a)` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:33.573352 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06117f2-2909-41a3-adee-d38c3ae9df7b None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:33.575186 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 568/1160] 10.222.0.93 () {56 vars in 1186 bytes} [Tue Jul 26 14:40:33 2022] GET /identity/v3/projects/0c5098ab70104c758e4fe7c86208551a => generated 311 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:40:33.581760 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f926ec48-7776-494c-9857-fb1b93e3eb72 None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:33.698722 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f926ec48-7776-494c-9857-fb1b93e3eb72 None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:33.742043 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9e5446-e774-480b-bce8-8f00a4ece56e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:33.743050 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9e5446-e774-480b-bce8-8f00a4ece56e None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:33.743429 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9e5446-e774-480b-bce8-8f00a4ece56e None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:33.743806 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9e5446-e774-480b-bce8-8f00a4ece56e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:33.744724 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9e5446-e774-480b-bce8-8f00a4ece56e None admin] RBAC: Adding query filter params (role.id=94e105ff8ee4486abd501415cc05ba38, scope.project.id=0c5098ab70104c758e4fe7c86208551a, user.id=f71a1854231946e6b515fe7ba54bb014) {{(pid=87056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:40:33.745093 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9e5446-e774-480b-bce8-8f00a4ece56e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:33.746833 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9e5446-e774-480b-bce8-8f00a4ece56e None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:33.754468 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 593/1161] 10.222.0.93 () {56 vars in 1374 bytes} [Tue Jul 26 14:40:33 2022] GET /identity/v3/role_assignments?user.id=f71a1854231946e6b515fe7ba54bb014&scope.project.id=0c5098ab70104c758e4fe7c86208551a&role.id=94e105ff8ee4486abd501415cc05ba38 => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:40:35.914048 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658323b7-dddd-4e6b-a41a-1d62ab8955e7 None None] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:35.914707 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658323b7-dddd-4e6b-a41a-1d62ab8955e7 None None] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:35.914707 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658323b7-dddd-4e6b-a41a-1d62ab8955e7 None None] PATH_INFO: `/` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:35.916054 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 569/1162] 10.222.0.93 () {54 vars in 926 bytes} [Tue Jul 26 14:40:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 14:40:35.921945 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de55dc2-20e4-46a7-9d5b-168aa470216a None None] REQUEST_METHOD: `POST` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:35.922525 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de55dc2-20e4-46a7-9d5b-168aa470216a None None] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:35.922525 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de55dc2-20e4-46a7-9d5b-168aa470216a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:35.942656 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.auth.core [None req-6de55dc2-20e4-46a7-9d5b-168aa470216a None None] MFA Rules not processed for user `e5ef88cc058f425b882bcb87a1e1e75c`. Rule list: `[]` (Enabled: `True`). {{(pid=87056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:40:35.943863 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.fernet_utils [None req-6de55dc2-20e4-46a7-9d5b-168aa470216a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:40:35.983899 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:36.031823 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 594/1163] 10.222.0.93 () {58 vars in 1023 bytes} [Tue Jul 26 14:40:35 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 14:40:36.056802 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658323b7-dddd-4e6b-a41a-1d62ab8955e7 None None] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:36.180968 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658323b7-dddd-4e6b-a41a-1d62ab8955e7 None None] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:36.225159 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463f6bc9-7b6f-4a90-9da1-399a21d714b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:36.225717 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463f6bc9-7b6f-4a90-9da1-399a21d714b0 None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:36.226007 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463f6bc9-7b6f-4a90-9da1-399a21d714b0 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:36.226350 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463f6bc9-7b6f-4a90-9da1-399a21d714b0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:36.248531 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:36.311852 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463f6bc9-7b6f-4a90-9da1-399a21d714b0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:36.313373 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463f6bc9-7b6f-4a90-9da1-399a21d714b0 None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:36.437421 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 570/1164] 10.222.0.93 () {58 vars in 1282 bytes} [Tue Jul 26 14:40:36 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 26 14:40:36.444018 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de55dc2-20e4-46a7-9d5b-168aa470216a None None] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:36.565218 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de55dc2-20e4-46a7-9d5b-168aa470216a None None] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:36.606645 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134ecd47-c6dd-4277-9f7d-d36adf0c4d9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:36.607713 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134ecd47-c6dd-4277-9f7d-d36adf0c4d9b None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:36.608208 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134ecd47-c6dd-4277-9f7d-d36adf0c4d9b None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:36.608877 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134ecd47-c6dd-4277-9f7d-d36adf0c4d9b None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:36.622411 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134ecd47-c6dd-4277-9f7d-d36adf0c4d9b None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:36.624493 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134ecd47-c6dd-4277-9f7d-d36adf0c4d9b None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:36.646668 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application [None req-134ecd47-c6dd-4277-9f7d-d36adf0c4d9b None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 26 14:40:36.646668 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:40:36.646668 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 26 14:40:36.646668 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 26 14:40:36.646668 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 14:40:36.646668 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 14:40:36.646668 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 14:40:36.646668 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 14:40:36.646668 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jul 26 14:40:36.646668 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Jul 26 14:40:36.646668 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 14:40:36.646668 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Jul 26 14:40:36.646668 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:40:36.646668 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:40:36.646668 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:40:36.646668 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:40:36.646668 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:40:36.648020 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:40:36.648020 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:40:36.648020 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:40:36.648020 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:40:36.648020 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:40:36.648020 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:40:36.648020 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 14:40:36.648020 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 14:40:36.648020 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 14:40:36.648020 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 14:40:36.648020 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:40:36.648020 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:40:36.648020 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:40:36.648020 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:40:36.648020 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:40:36.648020 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:40:36.654201 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:40:36.654201 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application with Lock( Jul 26 14:40:36.654201 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:40:36.654201 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:40:36.654201 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:40:36.654201 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:40:36.654201 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:40:36.654201 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:40:36.654201 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:40:36.654201 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:40:36.654201 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 26 14:40:36.654201 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 14:40:36.654201 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 26 14:40:36.654201 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Jul 26 14:40:36.654201 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 595/1165] 10.222.0.93 () {56 vars in 1117 bytes} [Tue Jul 26 14:40:36 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:40:36.655920 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463f6bc9-7b6f-4a90-9da1-399a21d714b0 None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:36.713183 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:36.772757 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463f6bc9-7b6f-4a90-9da1-399a21d714b0 None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:36.815117 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecee562-4edd-45f1-9c15-ef8ea4772a86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:36.815901 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecee562-4edd-45f1-9c15-ef8ea4772a86 None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:36.816127 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecee562-4edd-45f1-9c15-ef8ea4772a86 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:36.816415 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecee562-4edd-45f1-9c15-ef8ea4772a86 None admin] PATH_INFO: `/v3/domains` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:36.817114 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecee562-4edd-45f1-9c15-ef8ea4772a86 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=87055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:40:36.817417 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecee562-4edd-45f1-9c15-ef8ea4772a86 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:36.818859 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecee562-4edd-45f1-9c15-ef8ea4772a86 None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:36.827696 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 571/1166] 10.222.0.93 () {56 vars in 1115 bytes} [Tue Jul 26 14:40:36 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:40:38.937707 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b8fb31-cdce-4aae-b16f-4cf7e6d7df8e None None] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:38.938290 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b8fb31-cdce-4aae-b16f-4cf7e6d7df8e None None] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:38.938290 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b8fb31-cdce-4aae-b16f-4cf7e6d7df8e None None] PATH_INFO: `/` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:38.940331 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 596/1167] 10.222.0.93 () {54 vars in 926 bytes} [Tue Jul 26 14:40:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:40:38.947208 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65166a5b-a427-4f42-aecc-f66072232960 None None] REQUEST_METHOD: `POST` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:38.948041 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65166a5b-a427-4f42-aecc-f66072232960 None None] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:38.948218 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65166a5b-a427-4f42-aecc-f66072232960 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:38.969447 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.auth.core [None req-65166a5b-a427-4f42-aecc-f66072232960 None None] MFA Rules not processed for user `e5ef88cc058f425b882bcb87a1e1e75c`. Rule list: `[]` (Enabled: `True`). {{(pid=87055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:40:38.970911 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.fernet_utils [None req-65166a5b-a427-4f42-aecc-f66072232960 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:40:39.051441 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 572/1168] 10.222.0.93 () {58 vars in 1023 bytes} [Tue Jul 26 14:40:38 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 26 14:40:39.075211 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b8fb31-cdce-4aae-b16f-4cf7e6d7df8e None None] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:39.112213 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:39.193612 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b8fb31-cdce-4aae-b16f-4cf7e6d7df8e None None] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:39.233204 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbf8e23-f9ab-4087-995f-0f5330d15dde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:39.233760 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbf8e23-f9ab-4087-995f-0f5330d15dde None admin] REQUEST_METHOD: `POST` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:39.234040 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbf8e23-f9ab-4087-995f-0f5330d15dde None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:39.234349 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbf8e23-f9ab-4087-995f-0f5330d15dde None admin] PATH_INFO: `/v3/domains` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:39.235094 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbf8e23-f9ab-4087-995f-0f5330d15dde None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:39.237123 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbf8e23-f9ab-4087-995f-0f5330d15dde None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:39.359824 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 597/1169] 10.222.0.93 () {60 vars in 1138 bytes} [Tue Jul 26 14:40:39 2022] POST /identity/v3/domains => generated 267 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 14:40:41.671570 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6aa51f-efb0-4319-b367-4ea48d37c2e3 None None] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:41.672134 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6aa51f-efb0-4319-b367-4ea48d37c2e3 None None] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:41.672134 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6aa51f-efb0-4319-b367-4ea48d37c2e3 None None] PATH_INFO: `/` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:41.673790 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 573/1170] 10.222.0.93 () {54 vars in 926 bytes} [Tue Jul 26 14:40:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:40:41.679917 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8288144-ca33-4ab9-8bf7-597d64596e67 None None] REQUEST_METHOD: `POST` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:41.680732 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8288144-ca33-4ab9-8bf7-597d64596e67 None None] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:41.680732 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8288144-ca33-4ab9-8bf7-597d64596e67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:41.701459 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.auth.core [None req-a8288144-ca33-4ab9-8bf7-597d64596e67 None None] MFA Rules not processed for user `e5ef88cc058f425b882bcb87a1e1e75c`. Rule list: `[]` (Enabled: `True`). {{(pid=87056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:40:41.702717 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.fernet_utils [None req-a8288144-ca33-4ab9-8bf7-597d64596e67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:40:41.786926 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 598/1171] 10.222.0.93 () {58 vars in 1023 bytes} [Tue Jul 26 14:40:41 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 14:40:41.811580 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6aa51f-efb0-4319-b367-4ea48d37c2e3 None None] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:41.872859 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:41.944474 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6aa51f-efb0-4319-b367-4ea48d37c2e3 None None] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:41.985944 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f84cff7-3247-421e-ac37-8a94481ff3e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:41.986655 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f84cff7-3247-421e-ac37-8a94481ff3e1 None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:41.986935 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f84cff7-3247-421e-ac37-8a94481ff3e1 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:41.987211 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f84cff7-3247-421e-ac37-8a94481ff3e1 None admin] PATH_INFO: `/v3/domains/b317dffc8b8e4b4ab23ef006439ca09f` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:41.998851 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f84cff7-3247-421e-ac37-8a94481ff3e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=b317dffc8b8e4b4ab23ef006439ca09f)` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:42.000322 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f84cff7-3247-421e-ac37-8a94481ff3e1 None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:42.002702 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 574/1172] 10.222.0.93 () {56 vars in 1183 bytes} [Tue Jul 26 14:40:41 2022] GET /identity/v3/domains/b317dffc8b8e4b4ab23ef006439ca09f => generated 267 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:40:42.008974 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8288144-ca33-4ab9-8bf7-597d64596e67 None None] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:42.036096 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:42.119764 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8288144-ca33-4ab9-8bf7-597d64596e67 None None] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:42.161368 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2a6055-8dac-4678-b5f5-e3cc88295ec2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:42.162004 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2a6055-8dac-4678-b5f5-e3cc88295ec2 None admin] REQUEST_METHOD: `POST` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:42.162327 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2a6055-8dac-4678-b5f5-e3cc88295ec2 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:42.162605 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2a6055-8dac-4678-b5f5-e3cc88295ec2 None admin] PATH_INFO: `/v3/projects` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:42.163517 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2a6055-8dac-4678-b5f5-e3cc88295ec2 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:42.165001 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2a6055-8dac-4678-b5f5-e3cc88295ec2 None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:42.323106 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 599/1173] 10.222.0.93 () {60 vars in 1141 bytes} [Tue Jul 26 14:40:42 2022] POST /identity/v3/projects => generated 361 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 14:40:44.491721 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0943d24b-f520-4c66-9a9a-ec1614889475 None None] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:44.492308 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0943d24b-f520-4c66-9a9a-ec1614889475 None None] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:44.492308 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0943d24b-f520-4c66-9a9a-ec1614889475 None None] PATH_INFO: `/` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:44.493662 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 575/1174] 10.222.0.93 () {54 vars in 926 bytes} [Tue Jul 26 14:40:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:40:44.499444 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2f697d-d0d2-443d-b029-53c55f642c55 None None] REQUEST_METHOD: `POST` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:44.499995 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2f697d-d0d2-443d-b029-53c55f642c55 None None] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:44.499995 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2f697d-d0d2-443d-b029-53c55f642c55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:44.519771 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.auth.core [None req-9d2f697d-d0d2-443d-b029-53c55f642c55 None None] MFA Rules not processed for user `e5ef88cc058f425b882bcb87a1e1e75c`. Rule list: `[]` (Enabled: `True`). {{(pid=87056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:40:44.520998 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.fernet_utils [None req-9d2f697d-d0d2-443d-b029-53c55f642c55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:40:44.600018 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 600/1175] 10.222.0.93 () {58 vars in 1023 bytes} [Tue Jul 26 14:40:44 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 26 14:40:44.644018 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0943d24b-f520-4c66-9a9a-ec1614889475 None None] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:44.797385 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0943d24b-f520-4c66-9a9a-ec1614889475 None None] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:44.800254 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:44.839982 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe986303-84c0-40e8-bfdc-0d4670301db7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:44.840641 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe986303-84c0-40e8-bfdc-0d4670301db7 None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:44.840954 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe986303-84c0-40e8-bfdc-0d4670301db7 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:44.841239 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe986303-84c0-40e8-bfdc-0d4670301db7 None admin] PATH_INFO: `/v3/domains/b317dffc8b8e4b4ab23ef006439ca09f` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:44.842798 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe986303-84c0-40e8-bfdc-0d4670301db7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=b317dffc8b8e4b4ab23ef006439ca09f)` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:44.844338 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe986303-84c0-40e8-bfdc-0d4670301db7 None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:44.847220 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 576/1176] 10.222.0.93 () {56 vars in 1183 bytes} [Tue Jul 26 14:40:44 2022] GET /identity/v3/domains/b317dffc8b8e4b4ab23ef006439ca09f => generated 267 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:40:44.853838 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2f697d-d0d2-443d-b029-53c55f642c55 None None] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:44.857645 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:44.976606 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2f697d-d0d2-443d-b029-53c55f642c55 None None] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:45.021052 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e08fff-ec0d-4ed9-a983-c76daf2fef02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:45.021687 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e08fff-ec0d-4ed9-a983-c76daf2fef02 None admin] REQUEST_METHOD: `POST` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:45.021969 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e08fff-ec0d-4ed9-a983-c76daf2fef02 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:45.022275 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e08fff-ec0d-4ed9-a983-c76daf2fef02 None admin] PATH_INFO: `/v3/users` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:45.022981 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e08fff-ec0d-4ed9-a983-c76daf2fef02 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:45.024454 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e08fff-ec0d-4ed9-a983-c76daf2fef02 None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:45.127323 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 601/1177] 10.222.0.93 () {60 vars in 1132 bytes} [Tue Jul 26 14:40:44 2022] POST /identity/v3/users => generated 311 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 14:40:47.343179 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ce45ec-2237-41d7-b482-cee94e905b26 None None] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:47.343756 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ce45ec-2237-41d7-b482-cee94e905b26 None None] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:47.343756 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ce45ec-2237-41d7-b482-cee94e905b26 None None] PATH_INFO: `/` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:47.345970 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 577/1178] 10.222.0.93 () {54 vars in 926 bytes} [Tue Jul 26 14:40:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 14:40:47.352155 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee84bc3-91d2-441f-bf7b-b5c9d9a2be21 None None] REQUEST_METHOD: `POST` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:47.352727 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee84bc3-91d2-441f-bf7b-b5c9d9a2be21 None None] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:47.352727 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee84bc3-91d2-441f-bf7b-b5c9d9a2be21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:47.372495 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.auth.core [None req-7ee84bc3-91d2-441f-bf7b-b5c9d9a2be21 None None] MFA Rules not processed for user `e5ef88cc058f425b882bcb87a1e1e75c`. Rule list: `[]` (Enabled: `True`). {{(pid=87056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:40:47.373726 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.fernet_utils [None req-7ee84bc3-91d2-441f-bf7b-b5c9d9a2be21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:40:47.441480 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:47.454227 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 602/1179] 10.222.0.93 () {58 vars in 1023 bytes} [Tue Jul 26 14:40:47 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 14:40:47.478868 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ce45ec-2237-41d7-b482-cee94e905b26 None None] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:47.598613 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ce45ec-2237-41d7-b482-cee94e905b26 None None] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:47.641218 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827731bf-d2dd-4dd9-9eca-372d18a45db9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:47.642589 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827731bf-d2dd-4dd9-9eca-372d18a45db9 None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:47.642884 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827731bf-d2dd-4dd9-9eca-372d18a45db9 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:47.643258 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827731bf-d2dd-4dd9-9eca-372d18a45db9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:47.656650 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827731bf-d2dd-4dd9-9eca-372d18a45db9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 14:40:47.662363 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application [None req-827731bf-d2dd-4dd9-9eca-372d18a45db9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 14:40:47.662363 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:40:47.662363 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:40:47.662363 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:40:47.662363 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:40:47.662363 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:40:47.662363 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:40:47.662363 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:40:47.662363 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:40:47.662363 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:40:47.662363 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:40:47.662363 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:40:47.662363 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 14:40:47.662363 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 14:40:47.662363 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 14:40:47.662363 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 14:40:47.664080 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 14:40:47.664080 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 14:40:47.664080 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 14:40:47.664080 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 14:40:47.664080 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:40:47.664080 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:40:47.664080 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:40:47.664080 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:40:47.664080 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:40:47.664080 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:40:47.664080 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:40:47.664080 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application with Lock( Jul 26 14:40:47.664080 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:40:47.664080 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:40:47.664080 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:40:47.664080 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:40:47.665670 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:40:47.665670 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:40:47.665670 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:40:47.665670 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:40:47.665670 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 14:40:47.665670 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 14:40:47.665670 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 14:40:47.665670 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 14:40:47.665670 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 14:40:47.665670 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 14:40:47.665670 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 14:40:47.665670 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Jul 26 14:40:47.665670 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 578/1180] 10.222.0.93 () {56 vars in 1096 bytes} [Tue Jul 26 14:40:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:40:47.670286 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee84bc3-91d2-441f-bf7b-b5c9d9a2be21 None None] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:47.792895 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee84bc3-91d2-441f-bf7b-b5c9d9a2be21 None None] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:47.834355 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5557016-89f2-4de6-af03-6ca6b52f9a50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:47.835049 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5557016-89f2-4de6-af03-6ca6b52f9a50 None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:47.835378 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5557016-89f2-4de6-af03-6ca6b52f9a50 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:47.835705 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5557016-89f2-4de6-af03-6ca6b52f9a50 None admin] PATH_INFO: `/v3/roles` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:47.836502 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5557016-89f2-4de6-af03-6ca6b52f9a50 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:40:47.836868 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5557016-89f2-4de6-af03-6ca6b52f9a50 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:47.838375 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5557016-89f2-4de6-af03-6ca6b52f9a50 None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:47.849221 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 603/1181] 10.222.0.93 () {56 vars in 1099 bytes} [Tue Jul 26 14:40:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:40:47.855562 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827731bf-d2dd-4dd9-9eca-372d18a45db9 None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:47.892235 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:47.975650 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827731bf-d2dd-4dd9-9eca-372d18a45db9 None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:48.017097 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c450035e-3f85-4063-8581-4068fcf277bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:48.017824 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c450035e-3f85-4063-8581-4068fcf277bd None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:48.018146 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c450035e-3f85-4063-8581-4068fcf277bd None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:48.018514 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c450035e-3f85-4063-8581-4068fcf277bd None admin] PATH_INFO: `/v3/users/6b882ef60a984ca2b85746ae6d4825e3` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:48.036578 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c450035e-3f85-4063-8581-4068fcf277bd None admin] RBAC: Authorizing `identity:get_user(user_id=6b882ef60a984ca2b85746ae6d4825e3)` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:48.038196 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c450035e-3f85-4063-8581-4068fcf277bd None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:48.040115 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 579/1182] 10.222.0.93 () {56 vars in 1177 bytes} [Tue Jul 26 14:40:47 2022] GET /identity/v3/users/6b882ef60a984ca2b85746ae6d4825e3 => generated 311 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:40:48.046851 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5557016-89f2-4de6-af03-6ca6b52f9a50 None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:48.109793 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:48.166628 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5557016-89f2-4de6-af03-6ca6b52f9a50 None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:48.204637 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731c8dc0-a56a-436d-882c-73615324e473 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:48.205282 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731c8dc0-a56a-436d-882c-73615324e473 None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:48.205560 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731c8dc0-a56a-436d-882c-73615324e473 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:48.205830 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731c8dc0-a56a-436d-882c-73615324e473 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:48.286266 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731c8dc0-a56a-436d-882c-73615324e473 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:48.287846 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731c8dc0-a56a-436d-882c-73615324e473 None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:48.348431 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:48.404144 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 604/1183] 10.222.0.93 () {58 vars in 1282 bytes} [Tue Jul 26 14:40:48 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 26 14:40:48.410777 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c450035e-3f85-4063-8581-4068fcf277bd None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:48.514728 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:48.527718 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c450035e-3f85-4063-8581-4068fcf277bd None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:48.576450 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9470f8e2-59f7-4c53-928c-12b807c9fa87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:48.577556 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9470f8e2-59f7-4c53-928c-12b807c9fa87 None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:48.578051 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9470f8e2-59f7-4c53-928c-12b807c9fa87 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:48.578673 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9470f8e2-59f7-4c53-928c-12b807c9fa87 None admin] PATH_INFO: `/v3/projects/04961ce876864211945fbe4765479d60` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:48.581629 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9470f8e2-59f7-4c53-928c-12b807c9fa87 None admin] RBAC: Authorizing `identity:get_project(project_id=04961ce876864211945fbe4765479d60)` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:48.584363 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9470f8e2-59f7-4c53-928c-12b807c9fa87 None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:48.587854 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 580/1184] 10.222.0.93 () {56 vars in 1186 bytes} [Tue Jul 26 14:40:48 2022] GET /identity/v3/projects/04961ce876864211945fbe4765479d60 => generated 361 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:40:48.594313 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731c8dc0-a56a-436d-882c-73615324e473 None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:48.717252 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731c8dc0-a56a-436d-882c-73615324e473 None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:48.760485 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066c5d10-863d-4d59-9451-efb4c8de519b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:48.761188 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066c5d10-863d-4d59-9451-efb4c8de519b None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:48.761468 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066c5d10-863d-4d59-9451-efb4c8de519b None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:48.761742 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066c5d10-863d-4d59-9451-efb4c8de519b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:48.762578 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066c5d10-863d-4d59-9451-efb4c8de519b None admin] RBAC: Adding query filter params (role.id=94e105ff8ee4486abd501415cc05ba38, scope.project.id=04961ce876864211945fbe4765479d60, user.id=6b882ef60a984ca2b85746ae6d4825e3) {{(pid=87056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:40:48.762888 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066c5d10-863d-4d59-9451-efb4c8de519b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:48.764356 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066c5d10-863d-4d59-9451-efb4c8de519b None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:48.771875 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 605/1185] 10.222.0.93 () {56 vars in 1374 bytes} [Tue Jul 26 14:40:48 2022] GET /identity/v3/role_assignments?user.id=6b882ef60a984ca2b85746ae6d4825e3&scope.project.id=04961ce876864211945fbe4765479d60&role.id=94e105ff8ee4486abd501415cc05ba38 => generated 259 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:40:50.883795 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365e0d2b-7dd6-44db-8bc8-7c0237b649fa None None] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:50.884421 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365e0d2b-7dd6-44db-8bc8-7c0237b649fa None None] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:50.884421 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365e0d2b-7dd6-44db-8bc8-7c0237b649fa None None] PATH_INFO: `/` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:50.885926 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 581/1186] 10.222.0.93 () {54 vars in 926 bytes} [Tue Jul 26 14:40:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:40:50.896539 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea42c7d-303b-465f-a266-1101e41e02f4 None None] REQUEST_METHOD: `POST` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:50.897090 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea42c7d-303b-465f-a266-1101e41e02f4 None None] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:50.897520 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea42c7d-303b-465f-a266-1101e41e02f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:50.929891 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.auth.core [None req-fea42c7d-303b-465f-a266-1101e41e02f4 None None] MFA Rules not processed for user `e5ef88cc058f425b882bcb87a1e1e75c`. Rule list: `[]` (Enabled: `True`). {{(pid=87056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:40:50.932018 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.fernet_utils [None req-fea42c7d-303b-465f-a266-1101e41e02f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:40:50.954555 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:51.057803 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 606/1187] 10.222.0.93 () {58 vars in 1023 bytes} [Tue Jul 26 14:40:50 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 14:40:51.083293 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365e0d2b-7dd6-44db-8bc8-7c0237b649fa None None] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:51.281717 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365e0d2b-7dd6-44db-8bc8-7c0237b649fa None None] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:51.344518 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06691bff-4dcd-4a72-bb18-0ba7a97188c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:51.345703 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06691bff-4dcd-4a72-bb18-0ba7a97188c6 None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:51.346316 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06691bff-4dcd-4a72-bb18-0ba7a97188c6 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:51.346802 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06691bff-4dcd-4a72-bb18-0ba7a97188c6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:51.366589 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06691bff-4dcd-4a72-bb18-0ba7a97188c6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 14:40:51.376944 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application [None req-06691bff-4dcd-4a72-bb18-0ba7a97188c6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 14:40:51.376944 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:40:51.376944 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:40:51.376944 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:40:51.376944 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:40:51.376944 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:40:51.376944 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:40:51.376944 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:40:51.376944 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:40:51.376944 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:40:51.376944 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:40:51.376944 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:40:51.376944 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 14:40:51.376944 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 14:40:51.376944 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 14:40:51.376944 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 14:40:51.378746 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 14:40:51.378746 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 14:40:51.378746 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 14:40:51.378746 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 14:40:51.378746 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:40:51.378746 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:40:51.378746 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:40:51.378746 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:40:51.378746 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:40:51.378746 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:40:51.378746 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:40:51.378746 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application with Lock( Jul 26 14:40:51.378746 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:40:51.378746 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:40:51.378746 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:40:51.378746 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:40:51.380568 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:40:51.380568 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:40:51.380568 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:40:51.380568 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:40:51.380568 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 14:40:51.380568 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 14:40:51.380568 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 14:40:51.380568 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 14:40:51.380568 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 14:40:51.380568 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 14:40:51.380568 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 14:40:51.380568 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Jul 26 14:40:51.380568 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 582/1188] 10.222.0.93 () {56 vars in 1096 bytes} [Tue Jul 26 14:40:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:40:51.387107 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea42c7d-303b-465f-a266-1101e41e02f4 None None] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:51.508412 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea42c7d-303b-465f-a266-1101e41e02f4 None None] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:51.548697 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f663d10-793c-4b3c-9daa-a711e0438da5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:51.549295 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f663d10-793c-4b3c-9daa-a711e0438da5 None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:51.549577 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f663d10-793c-4b3c-9daa-a711e0438da5 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:51.549854 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f663d10-793c-4b3c-9daa-a711e0438da5 None admin] PATH_INFO: `/v3/roles` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:51.550656 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f663d10-793c-4b3c-9daa-a711e0438da5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:40:51.550969 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f663d10-793c-4b3c-9daa-a711e0438da5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:51.552495 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f663d10-793c-4b3c-9daa-a711e0438da5 None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:51.561996 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 607/1189] 10.222.0.93 () {56 vars in 1099 bytes} [Tue Jul 26 14:40:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:40:51.568381 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06691bff-4dcd-4a72-bb18-0ba7a97188c6 None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:51.590448 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:51.685115 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06691bff-4dcd-4a72-bb18-0ba7a97188c6 None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:51.728488 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd405f8e-e8cf-47a9-8f8e-145b1440c32f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:51.729148 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd405f8e-e8cf-47a9-8f8e-145b1440c32f None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:51.729433 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd405f8e-e8cf-47a9-8f8e-145b1440c32f None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:51.729781 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd405f8e-e8cf-47a9-8f8e-145b1440c32f None admin] PATH_INFO: `/v3/users/6b882ef60a984ca2b85746ae6d4825e3` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:51.731069 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd405f8e-e8cf-47a9-8f8e-145b1440c32f None admin] RBAC: Authorizing `identity:get_user(user_id=6b882ef60a984ca2b85746ae6d4825e3)` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:51.732568 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd405f8e-e8cf-47a9-8f8e-145b1440c32f None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:51.734368 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 583/1190] 10.222.0.93 () {56 vars in 1177 bytes} [Tue Jul 26 14:40:51 2022] GET /identity/v3/users/6b882ef60a984ca2b85746ae6d4825e3 => generated 311 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:40:51.740862 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f663d10-793c-4b3c-9daa-a711e0438da5 None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:51.754916 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:51.861599 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f663d10-793c-4b3c-9daa-a711e0438da5 None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:51.902465 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c275bfad-6d0b-4465-aed8-67a960e73401 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:51.903191 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c275bfad-6d0b-4465-aed8-67a960e73401 None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:51.903395 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c275bfad-6d0b-4465-aed8-67a960e73401 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:51.903665 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c275bfad-6d0b-4465-aed8-67a960e73401 None admin] PATH_INFO: `/v3/projects/04961ce876864211945fbe4765479d60` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:51.904930 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c275bfad-6d0b-4465-aed8-67a960e73401 None admin] RBAC: Authorizing `identity:get_project(project_id=04961ce876864211945fbe4765479d60)` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:51.906781 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c275bfad-6d0b-4465-aed8-67a960e73401 None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:51.909336 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 608/1191] 10.222.0.93 () {56 vars in 1186 bytes} [Tue Jul 26 14:40:51 2022] GET /identity/v3/projects/04961ce876864211945fbe4765479d60 => generated 361 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:40:51.916052 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd405f8e-e8cf-47a9-8f8e-145b1440c32f None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:52.016268 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:52.035640 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd405f8e-e8cf-47a9-8f8e-145b1440c32f None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:52.076112 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7af5ab-c035-4042-bea1-e707ce1408d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:52.076882 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7af5ab-c035-4042-bea1-e707ce1408d9 None admin] REQUEST_METHOD: `PUT` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:52.077209 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7af5ab-c035-4042-bea1-e707ce1408d9 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:52.077532 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7af5ab-c035-4042-bea1-e707ce1408d9 None admin] PATH_INFO: `/v3/projects/04961ce876864211945fbe4765479d60/users/6b882ef60a984ca2b85746ae6d4825e3/roles/94e105ff8ee4486abd501415cc05ba38` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:52.080529 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7af5ab-c035-4042-bea1-e707ce1408d9 None admin] RBAC: Authorizing `identity:create_grant(project_id=04961ce876864211945fbe4765479d60, user_id=6b882ef60a984ca2b85746ae6d4825e3, role_id=94e105ff8ee4486abd501415cc05ba38)` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:52.082097 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7af5ab-c035-4042-bea1-e707ce1408d9 None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:52.198617 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 584/1192] 10.222.0.93 () {58 vars in 1439 bytes} [Tue Jul 26 14:40:51 2022] PUT /identity/v3/projects/04961ce876864211945fbe4765479d60/users/6b882ef60a984ca2b85746ae6d4825e3/roles/94e105ff8ee4486abd501415cc05ba38 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 14:40:54.310997 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd50330-526c-4b40-b936-9cef6f8885a4 None None] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:54.311602 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd50330-526c-4b40-b936-9cef6f8885a4 None None] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:54.311602 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd50330-526c-4b40-b936-9cef6f8885a4 None None] PATH_INFO: `/` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:54.313636 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 609/1193] 10.222.0.93 () {54 vars in 926 bytes} [Tue Jul 26 14:40:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:40:54.319839 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac314c04-a8e2-4818-be56-59c6236fb5e9 None None] REQUEST_METHOD: `POST` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:54.320373 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac314c04-a8e2-4818-be56-59c6236fb5e9 None None] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:54.320503 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac314c04-a8e2-4818-be56-59c6236fb5e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:54.340952 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.auth.core [None req-ac314c04-a8e2-4818-be56-59c6236fb5e9 None None] MFA Rules not processed for user `e5ef88cc058f425b882bcb87a1e1e75c`. Rule list: `[]` (Enabled: `True`). {{(pid=87055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:40:54.342544 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.fernet_utils [None req-ac314c04-a8e2-4818-be56-59c6236fb5e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:40:54.424779 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 585/1194] 10.222.0.93 () {58 vars in 1023 bytes} [Tue Jul 26 14:40:54 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 14:40:54.449028 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd50330-526c-4b40-b936-9cef6f8885a4 None None] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:54.543877 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:54.572680 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd50330-526c-4b40-b936-9cef6f8885a4 None None] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:54.614605 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2f7496-87b5-4e17-ab2a-51822e6171e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:54.615499 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2f7496-87b5-4e17-ab2a-51822e6171e1 None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:54.615837 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2f7496-87b5-4e17-ab2a-51822e6171e1 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:54.616167 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2f7496-87b5-4e17-ab2a-51822e6171e1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:54.629695 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2f7496-87b5-4e17-ab2a-51822e6171e1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 14:40:54.635059 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application [None req-4c2f7496-87b5-4e17-ab2a-51822e6171e1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 14:40:54.635059 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:40:54.635059 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:40:54.635059 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:40:54.635059 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:40:54.635059 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:40:54.635059 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:40:54.635059 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:40:54.635059 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:40:54.635059 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:40:54.635059 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:40:54.635059 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:40:54.635059 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 14:40:54.635059 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 14:40:54.635059 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 14:40:54.635059 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 14:40:54.636779 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 14:40:54.636779 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 14:40:54.636779 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 14:40:54.636779 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 14:40:54.636779 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:40:54.636779 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:40:54.636779 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:40:54.636779 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:40:54.636779 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:40:54.636779 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:40:54.636779 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:40:54.636779 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application with Lock( Jul 26 14:40:54.636779 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:40:54.636779 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:40:54.636779 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:40:54.636779 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:40:54.638407 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:40:54.638407 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:40:54.638407 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:40:54.638407 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:40:54.638407 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 14:40:54.638407 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 14:40:54.638407 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 14:40:54.638407 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 14:40:54.638407 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 14:40:54.638407 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 14:40:54.638407 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 14:40:54.638407 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Jul 26 14:40:54.638407 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 610/1195] 10.222.0.93 () {56 vars in 1096 bytes} [Tue Jul 26 14:40:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:40:54.644980 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac314c04-a8e2-4818-be56-59c6236fb5e9 None None] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:54.731866 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:54.760457 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac314c04-a8e2-4818-be56-59c6236fb5e9 None None] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:54.802707 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf8dbe2-83a3-472b-bad2-b47ed76fa8b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:54.803400 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf8dbe2-83a3-472b-bad2-b47ed76fa8b4 None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:54.803752 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf8dbe2-83a3-472b-bad2-b47ed76fa8b4 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:54.804072 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf8dbe2-83a3-472b-bad2-b47ed76fa8b4 None admin] PATH_INFO: `/v3/roles` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:54.804867 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf8dbe2-83a3-472b-bad2-b47ed76fa8b4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:40:54.805217 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf8dbe2-83a3-472b-bad2-b47ed76fa8b4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:54.806778 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf8dbe2-83a3-472b-bad2-b47ed76fa8b4 None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:54.816874 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 586/1196] 10.222.0.93 () {56 vars in 1099 bytes} [Tue Jul 26 14:40:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:40:54.823359 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2f7496-87b5-4e17-ab2a-51822e6171e1 None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:54.961099 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2f7496-87b5-4e17-ab2a-51822e6171e1 None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:55.003340 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cad4efa-fca6-4b66-a059-268ec5300e67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:55.003999 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cad4efa-fca6-4b66-a059-268ec5300e67 None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:55.004288 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cad4efa-fca6-4b66-a059-268ec5300e67 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:55.004564 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cad4efa-fca6-4b66-a059-268ec5300e67 None admin] PATH_INFO: `/v3/users/6b882ef60a984ca2b85746ae6d4825e3` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:55.005873 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cad4efa-fca6-4b66-a059-268ec5300e67 None admin] RBAC: Authorizing `identity:get_user(user_id=6b882ef60a984ca2b85746ae6d4825e3)` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:55.007420 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cad4efa-fca6-4b66-a059-268ec5300e67 None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:55.009166 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 611/1197] 10.222.0.93 () {56 vars in 1177 bytes} [Tue Jul 26 14:40:54 2022] GET /identity/v3/users/6b882ef60a984ca2b85746ae6d4825e3 => generated 311 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:40:55.015519 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf8dbe2-83a3-472b-bad2-b47ed76fa8b4 None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:55.135717 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf8dbe2-83a3-472b-bad2-b47ed76fa8b4 None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:55.178211 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac241e80-736c-4f6f-9887-a85d6713cb21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:55.178934 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac241e80-736c-4f6f-9887-a85d6713cb21 None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:55.179272 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac241e80-736c-4f6f-9887-a85d6713cb21 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:55.179554 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac241e80-736c-4f6f-9887-a85d6713cb21 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:55.183945 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:55.307115 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac241e80-736c-4f6f-9887-a85d6713cb21 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:55.309731 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac241e80-736c-4f6f-9887-a85d6713cb21 None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:55.433130 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 587/1198] 10.222.0.93 () {58 vars in 1282 bytes} [Tue Jul 26 14:40:55 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 26 14:40:55.440749 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cad4efa-fca6-4b66-a059-268ec5300e67 None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:55.445298 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:55.572574 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cad4efa-fca6-4b66-a059-268ec5300e67 None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:55.612309 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a8061a-ae1b-4bf5-84ad-41d53ab02fbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:55.612992 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a8061a-ae1b-4bf5-84ad-41d53ab02fbf None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:55.613278 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a8061a-ae1b-4bf5-84ad-41d53ab02fbf None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:55.613567 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a8061a-ae1b-4bf5-84ad-41d53ab02fbf None admin] PATH_INFO: `/v3/projects/04961ce876864211945fbe4765479d60` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:55.614937 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a8061a-ae1b-4bf5-84ad-41d53ab02fbf None admin] RBAC: Authorizing `identity:get_project(project_id=04961ce876864211945fbe4765479d60)` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:55.616441 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a8061a-ae1b-4bf5-84ad-41d53ab02fbf None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:55.618300 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 612/1199] 10.222.0.93 () {56 vars in 1186 bytes} [Tue Jul 26 14:40:55 2022] GET /identity/v3/projects/04961ce876864211945fbe4765479d60 => generated 361 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:40:55.624868 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac241e80-736c-4f6f-9887-a85d6713cb21 None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:40:55.668332 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:55.772797 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac241e80-736c-4f6f-9887-a85d6713cb21 None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:40:55.834672 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a32a2c1-a079-4a3d-bee8-af47ae74f145 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:40:55.835736 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a32a2c1-a079-4a3d-bee8-af47ae74f145 None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:40:55.836228 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a32a2c1-a079-4a3d-bee8-af47ae74f145 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:40:55.836711 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a32a2c1-a079-4a3d-bee8-af47ae74f145 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:40:55.838180 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a32a2c1-a079-4a3d-bee8-af47ae74f145 None admin] RBAC: Adding query filter params (role.id=94e105ff8ee4486abd501415cc05ba38, scope.project.id=04961ce876864211945fbe4765479d60, user.id=6b882ef60a984ca2b85746ae6d4825e3) {{(pid=87055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:40:55.838749 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a32a2c1-a079-4a3d-bee8-af47ae74f145 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:40:55.841455 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a32a2c1-a079-4a3d-bee8-af47ae74f145 None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:40:55.853464 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 588/1200] 10.222.0.93 () {56 vars in 1374 bytes} [Tue Jul 26 14:40:55 2022] GET /identity/v3/role_assignments?user.id=6b882ef60a984ca2b85746ae6d4825e3&scope.project.id=04961ce876864211945fbe4765479d60&role.id=94e105ff8ee4486abd501415cc05ba38 => generated 608 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:41:05.606727 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=64 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:41:05.847900 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=50 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:42:22.613968 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1cde0f-c3e2-4b1a-a2be-9efb1da37a7c None None] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:42:22.614597 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1cde0f-c3e2-4b1a-a2be-9efb1da37a7c None None] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:42:22.614697 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1cde0f-c3e2-4b1a-a2be-9efb1da37a7c None None] PATH_INFO: `/` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:42:22.616164 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 613/1201] 10.222.0.93 () {54 vars in 926 bytes} [Tue Jul 26 14:42:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:42:22.622182 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f3fc15-66e9-4d35-a21a-518a41b3cd79 None None] REQUEST_METHOD: `POST` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:42:22.627110 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f3fc15-66e9-4d35-a21a-518a41b3cd79 None None] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:42:22.627110 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f3fc15-66e9-4d35-a21a-518a41b3cd79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:42:22.649671 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.auth.core [None req-52f3fc15-66e9-4d35-a21a-518a41b3cd79 None None] MFA Rules not processed for user `e5ef88cc058f425b882bcb87a1e1e75c`. Rule list: `[]` (Enabled: `True`). {{(pid=87055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:42:22.650945 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.fernet_utils [None req-52f3fc15-66e9-4d35-a21a-518a41b3cd79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:42:22.730219 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 589/1202] 10.222.0.93 () {58 vars in 1023 bytes} [Tue Jul 26 14:42:22 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 14:42:22.758333 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1cde0f-c3e2-4b1a-a2be-9efb1da37a7c None None] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:42:22.883631 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1cde0f-c3e2-4b1a-a2be-9efb1da37a7c None None] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:42:22.926115 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ebfd55-0fb8-4a0e-bc0b-01a7b43a4629 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:42:22.926925 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ebfd55-0fb8-4a0e-bc0b-01a7b43a4629 None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:42:22.927294 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ebfd55-0fb8-4a0e-bc0b-01a7b43a4629 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:42:22.927688 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ebfd55-0fb8-4a0e-bc0b-01a7b43a4629 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:42:22.941628 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ebfd55-0fb8-4a0e-bc0b-01a7b43a4629 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:42:22.943966 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ebfd55-0fb8-4a0e-bc0b-01a7b43a4629 None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:42:22.965203 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application [None req-b8ebfd55-0fb8-4a0e-bc0b-01a7b43a4629 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:42:22.965203 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:42:22.965203 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:42:22.965203 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:42:22.965203 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:42:22.965203 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:42:22.965203 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:42:22.965203 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:42:22.965203 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:42:22.965203 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:42:22.965203 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:42:22.965203 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:42:22.965203 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 14:42:22.965203 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 14:42:22.965203 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 14:42:22.967112 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 14:42:22.967112 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:42:22.967112 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:42:22.967112 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:42:22.967112 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:42:22.967112 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:42:22.967112 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:42:22.967112 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:42:22.967112 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application with Lock( Jul 26 14:42:22.967112 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:42:22.967112 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:42:22.967112 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:42:22.967112 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:42:22.967112 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:42:22.967112 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:42:22.967112 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:42:22.967112 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:42:22.968383 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 14:42:22.968383 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 14:42:22.968383 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:42:22.968383 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Jul 26 14:42:22.968383 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 614/1203] 10.222.0.93 () {56 vars in 1108 bytes} [Tue Jul 26 14:42:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:42:22.975182 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f3fc15-66e9-4d35-a21a-518a41b3cd79 None None] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:42:23.142829 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f3fc15-66e9-4d35-a21a-518a41b3cd79 None None] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:42:23.185932 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:42:23.192795 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6fb1b9-9405-4f34-b623-d4e9dec0d78f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:42:23.193487 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6fb1b9-9405-4f34-b623-d4e9dec0d78f None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:42:23.193812 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6fb1b9-9405-4f34-b623-d4e9dec0d78f None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:42:23.194136 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6fb1b9-9405-4f34-b623-d4e9dec0d78f None admin] PATH_INFO: `/v3/domains` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:42:23.194983 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6fb1b9-9405-4f34-b623-d4e9dec0d78f None admin] RBAC: Adding query filter params (name=Default) {{(pid=87055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:42:23.195343 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6fb1b9-9405-4f34-b623-d4e9dec0d78f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:42:23.196805 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6fb1b9-9405-4f34-b623-d4e9dec0d78f None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:42:23.211122 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 590/1204] 10.222.0.93 () {56 vars in 1109 bytes} [Tue Jul 26 14:42:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:42:23.221479 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ebfd55-0fb8-4a0e-bc0b-01a7b43a4629 None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:42:23.302597 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:42:23.358891 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ebfd55-0fb8-4a0e-bc0b-01a7b43a4629 None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:42:23.400292 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbd26b0-cf29-4b44-8a31-f09d449ed00e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:42:23.401023 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbd26b0-cf29-4b44-8a31-f09d449ed00e None admin] REQUEST_METHOD: `POST` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:42:23.401403 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbd26b0-cf29-4b44-8a31-f09d449ed00e None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:42:23.401853 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbd26b0-cf29-4b44-8a31-f09d449ed00e None admin] PATH_INFO: `/v3/users` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:42:23.402805 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbd26b0-cf29-4b44-8a31-f09d449ed00e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:42:23.405329 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbd26b0-cf29-4b44-8a31-f09d449ed00e None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:42:23.531727 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 615/1205] 10.222.0.93 () {60 vars in 1132 bytes} [Tue Jul 26 14:42:23 2022] POST /identity/v3/users => generated 251 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 14:42:26.047565 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9650a77-34b9-48e3-846a-77a3a5b24c69 None None] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:42:26.048123 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9650a77-34b9-48e3-846a-77a3a5b24c69 None None] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:42:26.048123 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9650a77-34b9-48e3-846a-77a3a5b24c69 None None] PATH_INFO: `/` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:42:26.049895 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 591/1206] 10.222.0.93 () {54 vars in 926 bytes} [Tue Jul 26 14:42:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:42:26.056104 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5249668e-b4b5-4d47-ba96-898af9b090b0 None None] REQUEST_METHOD: `POST` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:42:26.056660 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5249668e-b4b5-4d47-ba96-898af9b090b0 None None] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:42:26.056660 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5249668e-b4b5-4d47-ba96-898af9b090b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:42:26.077587 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.auth.core [None req-5249668e-b4b5-4d47-ba96-898af9b090b0 None None] MFA Rules not processed for user `e5ef88cc058f425b882bcb87a1e1e75c`. Rule list: `[]` (Enabled: `True`). {{(pid=87056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:42:26.078964 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.fernet_utils [None req-5249668e-b4b5-4d47-ba96-898af9b090b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:42:26.160895 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 616/1207] 10.222.0.93 () {58 vars in 1023 bytes} [Tue Jul 26 14:42:26 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 26 14:42:26.203109 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9650a77-34b9-48e3-846a-77a3a5b24c69 None None] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:42:26.365316 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9650a77-34b9-48e3-846a-77a3a5b24c69 None None] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:42:26.406201 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208e8659-01ea-4444-ad7f-f0af9c3690d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:42:26.406943 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208e8659-01ea-4444-ad7f-f0af9c3690d4 None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:42:26.407223 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208e8659-01ea-4444-ad7f-f0af9c3690d4 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:42:26.407498 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208e8659-01ea-4444-ad7f-f0af9c3690d4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:42:26.420190 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208e8659-01ea-4444-ad7f-f0af9c3690d4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 14:42:26.425183 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application [None req-208e8659-01ea-4444-ad7f-f0af9c3690d4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 26 14:42:26.425183 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:42:26.425183 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:42:26.425183 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:42:26.425183 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:42:26.425183 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:42:26.425183 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:42:26.425183 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:42:26.425183 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:42:26.425183 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:42:26.425183 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:42:26.425183 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:42:26.425183 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 14:42:26.425183 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 14:42:26.425183 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 14:42:26.425183 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 14:42:26.427059 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 14:42:26.427059 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 14:42:26.427059 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 14:42:26.427059 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 14:42:26.427059 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:42:26.427059 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:42:26.427059 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:42:26.427059 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:42:26.427059 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:42:26.427059 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:42:26.427059 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:42:26.427059 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application with Lock( Jul 26 14:42:26.427059 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:42:26.427059 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:42:26.427059 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:42:26.427059 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:42:26.429176 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:42:26.429176 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:42:26.429176 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:42:26.429176 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:42:26.429176 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 14:42:26.429176 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 14:42:26.429176 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 14:42:26.429176 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 14:42:26.429176 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 14:42:26.429176 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 14:42:26.429176 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 26 14:42:26.429176 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Jul 26 14:42:26.429176 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 592/1208] 10.222.0.93 () {56 vars in 1102 bytes} [Tue Jul 26 14:42:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:42:26.435749 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5249668e-b4b5-4d47-ba96-898af9b090b0 None None] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:42:26.487554 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:42:26.568060 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5249668e-b4b5-4d47-ba96-898af9b090b0 None None] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:42:26.623464 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1678e189-abe5-40af-9f45-96508c69057c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:42:26.624315 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1678e189-abe5-40af-9f45-96508c69057c None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:42:26.624597 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1678e189-abe5-40af-9f45-96508c69057c None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:42:26.624898 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1678e189-abe5-40af-9f45-96508c69057c None admin] PATH_INFO: `/v3/roles` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:42:26.626130 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1678e189-abe5-40af-9f45-96508c69057c None admin] RBAC: Adding query filter params (name=service) {{(pid=87056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:42:26.632876 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1678e189-abe5-40af-9f45-96508c69057c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:42:26.632876 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1678e189-abe5-40af-9f45-96508c69057c None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:42:26.640259 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 617/1209] 10.222.0.93 () {56 vars in 1103 bytes} [Tue Jul 26 14:42:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:42:26.646778 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208e8659-01ea-4444-ad7f-f0af9c3690d4 None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:42:26.708026 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:42:26.768701 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208e8659-01ea-4444-ad7f-f0af9c3690d4 None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:42:26.813426 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda70e13-2978-4fcc-94f0-4fac7b48f8d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:42:26.814084 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda70e13-2978-4fcc-94f0-4fac7b48f8d5 None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:42:26.814391 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda70e13-2978-4fcc-94f0-4fac7b48f8d5 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:42:26.814666 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda70e13-2978-4fcc-94f0-4fac7b48f8d5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:42:26.826717 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda70e13-2978-4fcc-94f0-4fac7b48f8d5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:42:26.828217 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda70e13-2978-4fcc-94f0-4fac7b48f8d5 None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:42:26.844033 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application [None req-fda70e13-2978-4fcc-94f0-4fac7b48f8d5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:42:26.844033 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:42:26.844033 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:42:26.844033 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:42:26.844033 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:42:26.844033 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:42:26.844033 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:42:26.844033 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:42:26.844033 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:42:26.844033 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:42:26.844033 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:42:26.844033 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:42:26.844033 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 14:42:26.844033 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 14:42:26.844033 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 14:42:26.845193 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 14:42:26.845193 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:42:26.845193 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:42:26.845193 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:42:26.845193 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:42:26.845193 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:42:26.845193 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:42:26.845193 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:42:26.845193 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application with Lock( Jul 26 14:42:26.845193 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:42:26.845193 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:42:26.845193 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:42:26.845193 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:42:26.845193 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:42:26.845193 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:42:26.845193 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:42:26.845193 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:42:26.846236 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 14:42:26.846236 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 14:42:26.846236 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:42:26.846236 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Jul 26 14:42:26.850120 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 593/1210] 10.222.0.93 () {56 vars in 1108 bytes} [Tue Jul 26 14:42:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 14:42:26.851352 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1678e189-abe5-40af-9f45-96508c69057c None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:42:26.981840 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:42:26.984888 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1678e189-abe5-40af-9f45-96508c69057c None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:42:27.021274 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c0b463-4282-44f3-8d84-9f33e1d92e37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:42:27.024053 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c0b463-4282-44f3-8d84-9f33e1d92e37 None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:42:27.024053 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c0b463-4282-44f3-8d84-9f33e1d92e37 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:42:27.024053 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c0b463-4282-44f3-8d84-9f33e1d92e37 None admin] PATH_INFO: `/v3/domains` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:42:27.024053 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c0b463-4282-44f3-8d84-9f33e1d92e37 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:42:27.024053 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c0b463-4282-44f3-8d84-9f33e1d92e37 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:42:27.024933 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c0b463-4282-44f3-8d84-9f33e1d92e37 None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:42:27.038469 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 618/1211] 10.222.0.93 () {56 vars in 1109 bytes} [Tue Jul 26 14:42:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:42:27.045012 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda70e13-2978-4fcc-94f0-4fac7b48f8d5 None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:42:27.173852 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda70e13-2978-4fcc-94f0-4fac7b48f8d5 None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:42:27.176017 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:42:27.213614 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b293ce-b460-4c3c-98f2-96aa1a14d65f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:42:27.214477 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b293ce-b460-4c3c-98f2-96aa1a14d65f None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:42:27.214757 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b293ce-b460-4c3c-98f2-96aa1a14d65f None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:42:27.215031 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b293ce-b460-4c3c-98f2-96aa1a14d65f None admin] PATH_INFO: `/v3/users/placement` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:42:27.224347 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b293ce-b460-4c3c-98f2-96aa1a14d65f None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:42:27.226086 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b293ce-b460-4c3c-98f2-96aa1a14d65f None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:42:27.241287 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application [None req-06b293ce-b460-4c3c-98f2-96aa1a14d65f None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 26 14:42:27.241287 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:42:27.241287 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:42:27.241287 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:42:27.241287 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:42:27.241287 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:42:27.241287 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:42:27.241287 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:42:27.241287 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:42:27.241287 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:42:27.241287 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:42:27.241287 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:42:27.241287 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 14:42:27.241287 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 14:42:27.241287 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 14:42:27.241287 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 14:42:27.243123 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:42:27.243123 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:42:27.243123 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 14:42:27.243123 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 14:42:27.243123 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 14:42:27.243123 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 14:42:27.243123 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:42:27.243123 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:42:27.243123 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:42:27.243123 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:42:27.243123 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:42:27.243123 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application with Lock( Jul 26 14:42:27.243123 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:42:27.243123 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:42:27.243123 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:42:27.243123 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:42:27.243123 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:42:27.243123 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:42:27.244513 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:42:27.244513 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:42:27.244513 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 14:42:27.244513 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 14:42:27.244513 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 14:42:27.244513 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 14:42:27.244513 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 14:42:27.244513 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 14:42:27.244513 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 26 14:42:27.244513 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Jul 26 14:42:27.244513 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 594/1212] 10.222.0.93 () {56 vars in 1108 bytes} [Tue Jul 26 14:42:27 2022] GET /identity/v3/users/placement => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:42:27.249942 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c0b463-4282-44f3-8d84-9f33e1d92e37 None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:42:27.377021 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c0b463-4282-44f3-8d84-9f33e1d92e37 None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:42:27.416876 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7667435c-3776-4ee3-96b9-c96410f81e16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:42:27.417519 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7667435c-3776-4ee3-96b9-c96410f81e16 None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:42:27.417801 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7667435c-3776-4ee3-96b9-c96410f81e16 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:42:27.418077 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7667435c-3776-4ee3-96b9-c96410f81e16 None admin] PATH_INFO: `/v3/users` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:42:27.419630 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7667435c-3776-4ee3-96b9-c96410f81e16 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:42:27.419907 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7667435c-3776-4ee3-96b9-c96410f81e16 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:42:27.421409 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7667435c-3776-4ee3-96b9-c96410f81e16 None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:42:27.443531 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 619/1213] 10.222.0.93 () {56 vars in 1143 bytes} [Tue Jul 26 14:42:27 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:42:27.449864 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b293ce-b460-4c3c-98f2-96aa1a14d65f None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:42:27.593232 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b293ce-b460-4c3c-98f2-96aa1a14d65f None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:42:27.630912 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed7eec6-73f8-48ed-862a-675c5c252865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:42:27.631538 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed7eec6-73f8-48ed-862a-675c5c252865 None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:42:27.631820 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed7eec6-73f8-48ed-862a-675c5c252865 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:42:27.632095 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed7eec6-73f8-48ed-862a-675c5c252865 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:42:27.666883 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:42:27.714910 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed7eec6-73f8-48ed-862a-675c5c252865 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:42:27.717499 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed7eec6-73f8-48ed-862a-675c5c252865 None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:42:27.830840 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 595/1214] 10.222.0.93 () {58 vars in 1282 bytes} [Tue Jul 26 14:42:27 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 26 14:42:27.837100 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7667435c-3776-4ee3-96b9-c96410f81e16 None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:42:27.859248 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:42:27.959783 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7667435c-3776-4ee3-96b9-c96410f81e16 None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:42:27.997514 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6115a7-bc49-4956-8234-39e2fb3592af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:42:27.998169 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6115a7-bc49-4956-8234-39e2fb3592af None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:42:27.998478 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6115a7-bc49-4956-8234-39e2fb3592af None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:42:27.998751 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6115a7-bc49-4956-8234-39e2fb3592af None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:42:28.009402 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6115a7-bc49-4956-8234-39e2fb3592af None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:42:28.010946 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6115a7-bc49-4956-8234-39e2fb3592af None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:42:28.026050 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application [None req-0b6115a7-bc49-4956-8234-39e2fb3592af None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:42:28.026050 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:42:28.026050 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:42:28.026050 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:42:28.026050 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:42:28.026050 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:42:28.026050 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:42:28.026050 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:42:28.026050 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:42:28.026050 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:42:28.026050 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:42:28.026050 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:42:28.026050 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 14:42:28.026050 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 14:42:28.026050 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 14:42:28.032170 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 14:42:28.032170 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:42:28.032170 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:42:28.032170 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:42:28.032170 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:42:28.032170 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:42:28.032170 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:42:28.032170 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:42:28.032170 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application with Lock( Jul 26 14:42:28.032170 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:42:28.032170 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:42:28.032170 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:42:28.032170 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:42:28.032170 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:42:28.032170 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:42:28.032170 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:42:28.032170 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:42:28.033439 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 14:42:28.033439 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 14:42:28.033439 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:42:28.033439 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Jul 26 14:42:28.033439 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 620/1215] 10.222.0.93 () {56 vars in 1108 bytes} [Tue Jul 26 14:42:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:42:28.034133 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed7eec6-73f8-48ed-862a-675c5c252865 None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:42:28.101054 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:42:28.142439 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed7eec6-73f8-48ed-862a-675c5c252865 None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:42:28.179196 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee568b8a-a95a-4d97-bb57-8e3db7982ecb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:42:28.179932 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee568b8a-a95a-4d97-bb57-8e3db7982ecb None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:42:28.180143 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee568b8a-a95a-4d97-bb57-8e3db7982ecb None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:42:28.180420 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee568b8a-a95a-4d97-bb57-8e3db7982ecb None admin] PATH_INFO: `/v3/domains` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:42:28.181170 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee568b8a-a95a-4d97-bb57-8e3db7982ecb None admin] RBAC: Adding query filter params (name=Default) {{(pid=87055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:42:28.181479 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee568b8a-a95a-4d97-bb57-8e3db7982ecb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:42:28.182982 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee568b8a-a95a-4d97-bb57-8e3db7982ecb None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:42:28.196502 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 596/1216] 10.222.0.93 () {56 vars in 1109 bytes} [Tue Jul 26 14:42:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:42:28.202911 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6115a7-bc49-4956-8234-39e2fb3592af None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:42:28.282156 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:42:28.319332 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6115a7-bc49-4956-8234-39e2fb3592af None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:42:28.361115 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cf4700-1923-43eb-a739-9a6611c9a089 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:42:28.361776 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cf4700-1923-43eb-a739-9a6611c9a089 None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:42:28.362059 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cf4700-1923-43eb-a739-9a6611c9a089 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:42:28.362366 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cf4700-1923-43eb-a739-9a6611c9a089 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:42:28.369956 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cf4700-1923-43eb-a739-9a6611c9a089 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:42:28.371540 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cf4700-1923-43eb-a739-9a6611c9a089 None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:42:28.384267 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application [None req-81cf4700-1923-43eb-a739-9a6611c9a089 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 14:42:28.384267 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:42:28.384267 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:42:28.384267 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:42:28.384267 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:42:28.384267 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:42:28.384267 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:42:28.384267 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:42:28.384267 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:42:28.384267 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:42:28.384267 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:42:28.384267 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:42:28.384267 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 14:42:28.384267 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 14:42:28.384267 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 14:42:28.385363 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 14:42:28.385363 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:42:28.385363 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:42:28.385363 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:42:28.385363 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:42:28.385363 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:42:28.385363 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:42:28.385363 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:42:28.385363 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application with Lock( Jul 26 14:42:28.385363 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:42:28.385363 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:42:28.385363 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:42:28.385363 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:42:28.385363 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:42:28.385363 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:42:28.385363 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:42:28.385363 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:42:28.386379 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 14:42:28.386379 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 14:42:28.386379 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 14:42:28.386379 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 14:42:28.386379 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 14:42:28.386379 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 14:42:28.386379 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 14:42:28.386379 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Jul 26 14:42:28.386379 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 621/1217] 10.222.0.93 () {56 vars in 1111 bytes} [Tue Jul 26 14:42:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 14:42:28.393381 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee568b8a-a95a-4d97-bb57-8e3db7982ecb None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:42:28.524739 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee568b8a-a95a-4d97-bb57-8e3db7982ecb None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:42:28.551363 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:42:28.563974 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd17781a-333c-458f-9fd3-0ce3d880368e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:42:28.564598 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd17781a-333c-458f-9fd3-0ce3d880368e None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:42:28.564878 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd17781a-333c-458f-9fd3-0ce3d880368e None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:42:28.565151 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd17781a-333c-458f-9fd3-0ce3d880368e None admin] PATH_INFO: `/v3/projects` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:42:28.565900 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd17781a-333c-458f-9fd3-0ce3d880368e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:42:28.566205 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd17781a-333c-458f-9fd3-0ce3d880368e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:42:28.567762 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd17781a-333c-458f-9fd3-0ce3d880368e None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:42:28.581424 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 597/1218] 10.222.0.93 () {56 vars in 1148 bytes} [Tue Jul 26 14:42:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:42:28.591458 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cf4700-1923-43eb-a739-9a6611c9a089 None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:42:28.722658 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cf4700-1923-43eb-a739-9a6611c9a089 None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:42:28.771018 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:42:28.775590 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a33fd62-090e-4e70-ae78-fc81c406ea3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:42:28.776365 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a33fd62-090e-4e70-ae78-fc81c406ea3b None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:42:28.776636 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a33fd62-090e-4e70-ae78-fc81c406ea3b None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:42:28.776913 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a33fd62-090e-4e70-ae78-fc81c406ea3b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:42:28.777723 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a33fd62-090e-4e70-ae78-fc81c406ea3b None admin] RBAC: Adding query filter params (role.id=2e45ca312cda4bef9263725ae1c6dab7, scope.project.id=c422a2290a14424da20e2841cbc1741d, user.id=3e27fe21cc6048d5b9899b938d84ba5f) {{(pid=87056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:42:28.778061 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a33fd62-090e-4e70-ae78-fc81c406ea3b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:42:28.779713 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a33fd62-090e-4e70-ae78-fc81c406ea3b None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:42:28.786373 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 622/1219] 10.222.0.93 () {56 vars in 1374 bytes} [Tue Jul 26 14:42:28 2022] GET /identity/v3/role_assignments?user.id=3e27fe21cc6048d5b9899b938d84ba5f&scope.project.id=c422a2290a14424da20e2841cbc1741d&role.id=2e45ca312cda4bef9263725ae1c6dab7 => generated 259 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:42:31.053447 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306ad944-1e65-487c-b306-6c8123db7168 None None] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:42:31.053980 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306ad944-1e65-487c-b306-6c8123db7168 None None] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:42:31.053980 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306ad944-1e65-487c-b306-6c8123db7168 None None] PATH_INFO: `/` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:42:31.055612 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 598/1220] 10.222.0.93 () {54 vars in 926 bytes} [Tue Jul 26 14:42:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 14:42:31.063107 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27a9c05-c281-452c-b125-bb57b3271622 None None] REQUEST_METHOD: `POST` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:42:31.063964 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27a9c05-c281-452c-b125-bb57b3271622 None None] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:42:31.063964 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27a9c05-c281-452c-b125-bb57b3271622 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:42:31.085005 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.auth.core [None req-f27a9c05-c281-452c-b125-bb57b3271622 None None] MFA Rules not processed for user `e5ef88cc058f425b882bcb87a1e1e75c`. Rule list: `[]` (Enabled: `True`). {{(pid=87056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:42:31.086349 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.fernet_utils [None req-f27a9c05-c281-452c-b125-bb57b3271622 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:42:31.175184 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 623/1221] 10.222.0.93 () {58 vars in 1023 bytes} [Tue Jul 26 14:42:31 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 26 14:42:31.216452 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306ad944-1e65-487c-b306-6c8123db7168 None None] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:42:31.348588 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306ad944-1e65-487c-b306-6c8123db7168 None None] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:42:31.389898 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04039d2-6632-4135-8d9d-81f94078ff5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:42:31.390753 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04039d2-6632-4135-8d9d-81f94078ff5e None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:42:31.391209 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04039d2-6632-4135-8d9d-81f94078ff5e None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:42:31.391650 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04039d2-6632-4135-8d9d-81f94078ff5e None admin] PATH_INFO: `/v3/roles/service` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:42:31.416823 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04039d2-6632-4135-8d9d-81f94078ff5e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 14:42:31.422968 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application [None req-b04039d2-6632-4135-8d9d-81f94078ff5e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 26 14:42:31.422968 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:42:31.422968 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:42:31.422968 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:42:31.422968 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:42:31.422968 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:42:31.422968 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:42:31.422968 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:42:31.422968 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:42:31.422968 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:42:31.422968 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:42:31.422968 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:42:31.422968 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 14:42:31.422968 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 14:42:31.422968 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 14:42:31.422968 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 14:42:31.425111 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 14:42:31.425111 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 14:42:31.425111 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 14:42:31.425111 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 14:42:31.425111 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:42:31.425111 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:42:31.425111 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:42:31.425111 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:42:31.425111 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:42:31.425111 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:42:31.425111 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:42:31.425111 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application with Lock( Jul 26 14:42:31.425111 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:42:31.425111 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:42:31.425111 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:42:31.425111 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:42:31.426025 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:42:31.426025 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:42:31.426025 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:42:31.426025 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:42:31.426025 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 14:42:31.426025 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 14:42:31.426025 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 14:42:31.426025 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 14:42:31.426025 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 14:42:31.426025 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 14:42:31.426025 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 26 14:42:31.426025 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Jul 26 14:42:31.426025 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 599/1222] 10.222.0.93 () {56 vars in 1102 bytes} [Tue Jul 26 14:42:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:42:31.436040 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27a9c05-c281-452c-b125-bb57b3271622 None None] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:42:31.587139 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27a9c05-c281-452c-b125-bb57b3271622 None None] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:42:31.617441 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:42:31.633402 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adf023f-3c7b-4efc-b198-f04200a7a337 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:42:31.634051 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adf023f-3c7b-4efc-b198-f04200a7a337 None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:42:31.634365 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adf023f-3c7b-4efc-b198-f04200a7a337 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:42:31.634645 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adf023f-3c7b-4efc-b198-f04200a7a337 None admin] PATH_INFO: `/v3/roles` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:42:31.635386 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adf023f-3c7b-4efc-b198-f04200a7a337 None admin] RBAC: Adding query filter params (name=service) {{(pid=87056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:42:31.635690 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adf023f-3c7b-4efc-b198-f04200a7a337 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:42:31.637099 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adf023f-3c7b-4efc-b198-f04200a7a337 None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:42:31.647532 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 624/1223] 10.222.0.93 () {56 vars in 1103 bytes} [Tue Jul 26 14:42:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:42:31.654501 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04039d2-6632-4135-8d9d-81f94078ff5e None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:42:31.709984 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:42:31.793209 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04039d2-6632-4135-8d9d-81f94078ff5e None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:42:31.834948 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b04a2c-94f8-4052-ab0a-c67ed1e31642 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:42:31.835628 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b04a2c-94f8-4052-ab0a-c67ed1e31642 None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:42:31.835911 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b04a2c-94f8-4052-ab0a-c67ed1e31642 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:42:31.836191 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b04a2c-94f8-4052-ab0a-c67ed1e31642 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:42:31.849282 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b04a2c-94f8-4052-ab0a-c67ed1e31642 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:42:31.850936 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b04a2c-94f8-4052-ab0a-c67ed1e31642 None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:42:31.875599 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application [None req-97b04a2c-94f8-4052-ab0a-c67ed1e31642 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:42:31.875599 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:42:31.875599 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:42:31.875599 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:42:31.875599 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:42:31.875599 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:42:31.875599 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:42:31.875599 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:42:31.875599 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:42:31.875599 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:42:31.875599 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:42:31.875599 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:42:31.875599 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 14:42:31.875599 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 14:42:31.875599 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 14:42:31.877833 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 14:42:31.877833 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:42:31.877833 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:42:31.877833 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:42:31.877833 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:42:31.877833 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:42:31.877833 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:42:31.877833 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:42:31.877833 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application with Lock( Jul 26 14:42:31.877833 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:42:31.877833 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:42:31.877833 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:42:31.877833 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:42:31.877833 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:42:31.877833 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:42:31.877833 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:42:31.877833 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:42:31.880354 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 14:42:31.880354 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 14:42:31.880354 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:42:31.880354 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Jul 26 14:42:31.880354 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 600/1224] 10.222.0.93 () {56 vars in 1108 bytes} [Tue Jul 26 14:42:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:42:31.882735 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adf023f-3c7b-4efc-b198-f04200a7a337 None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:42:31.998573 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adf023f-3c7b-4efc-b198-f04200a7a337 None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:42:32.039947 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b85389-8c35-40f5-917b-60836dd0857a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:42:32.040587 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b85389-8c35-40f5-917b-60836dd0857a None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:42:32.040870 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b85389-8c35-40f5-917b-60836dd0857a None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:42:32.041148 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b85389-8c35-40f5-917b-60836dd0857a None admin] PATH_INFO: `/v3/domains` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:42:32.041850 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b85389-8c35-40f5-917b-60836dd0857a None admin] RBAC: Adding query filter params (name=Default) {{(pid=87056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:42:32.042159 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b85389-8c35-40f5-917b-60836dd0857a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:42:32.044202 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b85389-8c35-40f5-917b-60836dd0857a None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:42:32.059775 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 625/1225] 10.222.0.93 () {56 vars in 1109 bytes} [Tue Jul 26 14:42:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:42:32.068447 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b04a2c-94f8-4052-ab0a-c67ed1e31642 None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:42:32.185069 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:42:32.193160 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b04a2c-94f8-4052-ab0a-c67ed1e31642 None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:42:32.233808 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbc1478-8dcd-4d0f-9afd-d0a996f4ff07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:42:32.234493 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbc1478-8dcd-4d0f-9afd-d0a996f4ff07 None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:42:32.234773 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbc1478-8dcd-4d0f-9afd-d0a996f4ff07 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:42:32.235049 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbc1478-8dcd-4d0f-9afd-d0a996f4ff07 None admin] PATH_INFO: `/v3/users/placement` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:42:32.243394 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbc1478-8dcd-4d0f-9afd-d0a996f4ff07 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:42:32.245061 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbc1478-8dcd-4d0f-9afd-d0a996f4ff07 None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:42:32.258807 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application [None req-7dbc1478-8dcd-4d0f-9afd-d0a996f4ff07 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 26 14:42:32.258807 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:42:32.258807 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:42:32.258807 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:42:32.258807 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:42:32.258807 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:42:32.258807 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:42:32.258807 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:42:32.258807 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:42:32.258807 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:42:32.258807 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:42:32.258807 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:42:32.258807 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 14:42:32.258807 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 14:42:32.258807 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 14:42:32.258807 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 14:42:32.260669 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:42:32.260669 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:42:32.260669 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 14:42:32.260669 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 14:42:32.260669 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 14:42:32.260669 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 14:42:32.260669 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:42:32.260669 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:42:32.260669 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:42:32.260669 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:42:32.260669 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:42:32.260669 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application with Lock( Jul 26 14:42:32.260669 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:42:32.260669 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:42:32.260669 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:42:32.260669 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:42:32.260669 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:42:32.260669 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:42:32.263266 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:42:32.263266 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:42:32.263266 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 14:42:32.263266 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 14:42:32.263266 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 14:42:32.263266 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 14:42:32.263266 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 14:42:32.263266 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 14:42:32.263266 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 26 14:42:32.263266 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Jul 26 14:42:32.263266 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 601/1226] 10.222.0.93 () {56 vars in 1108 bytes} [Tue Jul 26 14:42:32 2022] GET /identity/v3/users/placement => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:42:32.270395 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b85389-8c35-40f5-917b-60836dd0857a None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:42:32.336636 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:42:32.400245 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b85389-8c35-40f5-917b-60836dd0857a None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:42:32.440544 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac29fd4-5b89-41b1-9332-34551b42c09c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:42:32.441097 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac29fd4-5b89-41b1-9332-34551b42c09c None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:42:32.441381 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac29fd4-5b89-41b1-9332-34551b42c09c None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:42:32.441652 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac29fd4-5b89-41b1-9332-34551b42c09c None admin] PATH_INFO: `/v3/users` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:42:32.442505 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac29fd4-5b89-41b1-9332-34551b42c09c None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:42:32.442814 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac29fd4-5b89-41b1-9332-34551b42c09c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:42:32.444331 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac29fd4-5b89-41b1-9332-34551b42c09c None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:42:32.468458 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 626/1227] 10.222.0.93 () {56 vars in 1143 bytes} [Tue Jul 26 14:42:32 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:42:32.474971 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbc1478-8dcd-4d0f-9afd-d0a996f4ff07 None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:42:32.599277 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbc1478-8dcd-4d0f-9afd-d0a996f4ff07 None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:42:32.636971 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3563f794-4afd-439b-aaba-55c996829d05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:42:32.637789 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3563f794-4afd-439b-aaba-55c996829d05 None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:42:32.638068 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3563f794-4afd-439b-aaba-55c996829d05 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:42:32.638376 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3563f794-4afd-439b-aaba-55c996829d05 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:42:32.650717 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3563f794-4afd-439b-aaba-55c996829d05 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:42:32.652290 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3563f794-4afd-439b-aaba-55c996829d05 None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:42:32.671087 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application [None req-3563f794-4afd-439b-aaba-55c996829d05 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:42:32.671087 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:42:32.671087 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:42:32.671087 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:42:32.671087 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:42:32.671087 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:42:32.671087 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:42:32.671087 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:42:32.671087 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:42:32.671087 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:42:32.671087 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:42:32.671087 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:42:32.671087 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 14:42:32.671087 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 14:42:32.671087 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 14:42:32.672746 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 14:42:32.672746 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:42:32.672746 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:42:32.672746 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:42:32.672746 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:42:32.672746 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:42:32.672746 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:42:32.672746 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:42:32.672746 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application with Lock( Jul 26 14:42:32.672746 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:42:32.672746 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:42:32.672746 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:42:32.672746 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:42:32.672746 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:42:32.672746 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:42:32.672746 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:42:32.672746 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:42:32.674531 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 14:42:32.674531 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 14:42:32.674531 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:42:32.674531 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Jul 26 14:42:32.674531 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 602/1228] 10.222.0.93 () {56 vars in 1108 bytes} [Tue Jul 26 14:42:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:42:32.679665 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac29fd4-5b89-41b1-9332-34551b42c09c None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:42:32.804970 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac29fd4-5b89-41b1-9332-34551b42c09c None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:42:32.808083 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:42:32.848912 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642439ac-dbe4-4a74-b5af-79cef369500b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:42:32.849558 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642439ac-dbe4-4a74-b5af-79cef369500b None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:42:32.849833 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642439ac-dbe4-4a74-b5af-79cef369500b None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:42:32.850107 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642439ac-dbe4-4a74-b5af-79cef369500b None admin] PATH_INFO: `/v3/domains` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:42:32.850944 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642439ac-dbe4-4a74-b5af-79cef369500b None admin] RBAC: Adding query filter params (name=Default) {{(pid=87056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:42:32.851252 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642439ac-dbe4-4a74-b5af-79cef369500b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:42:32.852649 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642439ac-dbe4-4a74-b5af-79cef369500b None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:42:32.865938 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 627/1229] 10.222.0.93 () {56 vars in 1109 bytes} [Tue Jul 26 14:42:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:42:32.872767 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3563f794-4afd-439b-aaba-55c996829d05 None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:42:32.883560 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:42:33.005558 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3563f794-4afd-439b-aaba-55c996829d05 None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:42:33.055269 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054da35c-10f9-4cf8-8f80-199650b89cd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:42:33.056064 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054da35c-10f9-4cf8-8f80-199650b89cd3 None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:42:33.056343 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054da35c-10f9-4cf8-8f80-199650b89cd3 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:42:33.056622 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054da35c-10f9-4cf8-8f80-199650b89cd3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:42:33.068053 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054da35c-10f9-4cf8-8f80-199650b89cd3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:42:33.071131 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054da35c-10f9-4cf8-8f80-199650b89cd3 None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:42:33.095169 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application [None req-054da35c-10f9-4cf8-8f80-199650b89cd3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 14:42:33.095169 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:42:33.095169 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:42:33.095169 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:42:33.095169 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:42:33.095169 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:42:33.095169 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:42:33.095169 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:42:33.095169 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:42:33.095169 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:42:33.095169 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:42:33.095169 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:42:33.095169 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 14:42:33.095169 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 14:42:33.095169 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 14:42:33.096344 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 14:42:33.096344 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:42:33.096344 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:42:33.096344 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:42:33.096344 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:42:33.096344 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:42:33.096344 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:42:33.096344 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:42:33.096344 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application with Lock( Jul 26 14:42:33.096344 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:42:33.096344 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:42:33.096344 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:42:33.096344 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:42:33.096344 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:42:33.096344 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:42:33.096344 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:42:33.096344 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:42:33.097397 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 14:42:33.097397 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 14:42:33.097397 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 14:42:33.097397 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 14:42:33.097397 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 14:42:33.097397 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 14:42:33.097397 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 14:42:33.097397 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Jul 26 14:42:33.097936 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 603/1230] 10.222.0.93 () {56 vars in 1111 bytes} [Tue Jul 26 14:42:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 14:42:33.104628 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642439ac-dbe4-4a74-b5af-79cef369500b None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:42:33.234549 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642439ac-dbe4-4a74-b5af-79cef369500b None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:42:33.276053 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7db4f97-4197-4ab0-a9f3-4c7e8ccfaa92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:42:33.276897 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7db4f97-4197-4ab0-a9f3-4c7e8ccfaa92 None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:42:33.277032 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7db4f97-4197-4ab0-a9f3-4c7e8ccfaa92 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:42:33.277280 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7db4f97-4197-4ab0-a9f3-4c7e8ccfaa92 None admin] PATH_INFO: `/v3/projects` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:42:33.278775 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7db4f97-4197-4ab0-a9f3-4c7e8ccfaa92 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:42:33.279109 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7db4f97-4197-4ab0-a9f3-4c7e8ccfaa92 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:42:33.280585 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7db4f97-4197-4ab0-a9f3-4c7e8ccfaa92 None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:42:33.295409 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 628/1231] 10.222.0.93 () {56 vars in 1148 bytes} [Tue Jul 26 14:42:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:42:33.306110 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054da35c-10f9-4cf8-8f80-199650b89cd3 None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:42:33.434635 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:42:33.491003 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054da35c-10f9-4cf8-8f80-199650b89cd3 None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:42:33.536675 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c160c2-09b9-4edc-92b9-d7e31f10394f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:42:33.537719 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c160c2-09b9-4edc-92b9-d7e31f10394f None admin] REQUEST_METHOD: `PUT` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:42:33.538229 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c160c2-09b9-4edc-92b9-d7e31f10394f None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:42:33.538770 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c160c2-09b9-4edc-92b9-d7e31f10394f None admin] PATH_INFO: `/v3/projects/c422a2290a14424da20e2841cbc1741d/users/3e27fe21cc6048d5b9899b938d84ba5f/roles/2e45ca312cda4bef9263725ae1c6dab7` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:42:33.567386 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c160c2-09b9-4edc-92b9-d7e31f10394f None admin] RBAC: Authorizing `identity:create_grant(project_id=c422a2290a14424da20e2841cbc1741d, user_id=3e27fe21cc6048d5b9899b938d84ba5f, role_id=2e45ca312cda4bef9263725ae1c6dab7)` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:42:33.570232 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c160c2-09b9-4edc-92b9-d7e31f10394f None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:42:33.745403 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 604/1232] 10.222.0.93 () {58 vars in 1439 bytes} [Tue Jul 26 14:42:33 2022] PUT /identity/v3/projects/c422a2290a14424da20e2841cbc1741d/users/3e27fe21cc6048d5b9899b938d84ba5f/roles/2e45ca312cda4bef9263725ae1c6dab7 => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 14:42:35.899917 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47255d64-708e-4e91-8156-e41d80dbd983 None None] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:42:35.900474 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47255d64-708e-4e91-8156-e41d80dbd983 None None] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:42:35.900474 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47255d64-708e-4e91-8156-e41d80dbd983 None None] PATH_INFO: `/` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:42:35.902096 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 629/1233] 10.222.0.93 () {54 vars in 926 bytes} [Tue Jul 26 14:42:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 14:42:35.908673 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddf5eb1-bf70-4e6e-9516-49bb3bfbfe52 None None] REQUEST_METHOD: `POST` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:42:35.909461 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddf5eb1-bf70-4e6e-9516-49bb3bfbfe52 None None] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:42:35.909461 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddf5eb1-bf70-4e6e-9516-49bb3bfbfe52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:42:35.933123 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.auth.core [None req-cddf5eb1-bf70-4e6e-9516-49bb3bfbfe52 None None] MFA Rules not processed for user `e5ef88cc058f425b882bcb87a1e1e75c`. Rule list: `[]` (Enabled: `True`). {{(pid=87055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:42:35.935949 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.fernet_utils [None req-cddf5eb1-bf70-4e6e-9516-49bb3bfbfe52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:42:36.023275 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 605/1234] 10.222.0.93 () {58 vars in 1023 bytes} [Tue Jul 26 14:42:35 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 26 14:42:36.049237 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47255d64-708e-4e91-8156-e41d80dbd983 None None] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:42:36.079898 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:42:36.171759 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47255d64-708e-4e91-8156-e41d80dbd983 None None] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:42:36.216247 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b563d5-ab8f-41c0-9f8c-2c4043c82c13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:42:36.217218 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b563d5-ab8f-41c0-9f8c-2c4043c82c13 None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:42:36.217684 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b563d5-ab8f-41c0-9f8c-2c4043c82c13 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:42:36.218159 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b563d5-ab8f-41c0-9f8c-2c4043c82c13 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:42:36.239381 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b563d5-ab8f-41c0-9f8c-2c4043c82c13 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 14:42:36.249963 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application [None req-49b563d5-ab8f-41c0-9f8c-2c4043c82c13 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 26 14:42:36.249963 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:42:36.249963 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:42:36.249963 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:42:36.249963 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:42:36.249963 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:42:36.249963 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:42:36.249963 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:42:36.249963 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:42:36.249963 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:42:36.249963 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:42:36.249963 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:42:36.249963 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 14:42:36.249963 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 14:42:36.249963 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 14:42:36.249963 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 14:42:36.254502 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 14:42:36.254502 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 14:42:36.254502 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 14:42:36.254502 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 14:42:36.254502 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:42:36.254502 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:42:36.254502 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:42:36.254502 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:42:36.254502 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:42:36.254502 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:42:36.254502 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:42:36.254502 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application with Lock( Jul 26 14:42:36.254502 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:42:36.254502 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:42:36.254502 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:42:36.254502 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:42:36.255491 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:42:36.255491 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:42:36.255491 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:42:36.255491 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:42:36.255491 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 14:42:36.255491 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 14:42:36.255491 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 14:42:36.255491 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 14:42:36.255491 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 14:42:36.255491 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 14:42:36.255491 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 26 14:42:36.255491 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Jul 26 14:42:36.255491 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 630/1235] 10.222.0.93 () {56 vars in 1102 bytes} [Tue Jul 26 14:42:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:42:36.259134 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddf5eb1-bf70-4e6e-9516-49bb3bfbfe52 None None] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:42:36.316231 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:42:36.379829 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddf5eb1-bf70-4e6e-9516-49bb3bfbfe52 None None] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:42:36.420546 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b369d0bc-2ad4-40f8-ab3e-e4e48381ddd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:42:36.421232 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b369d0bc-2ad4-40f8-ab3e-e4e48381ddd6 None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:42:36.421548 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b369d0bc-2ad4-40f8-ab3e-e4e48381ddd6 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:42:36.421822 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b369d0bc-2ad4-40f8-ab3e-e4e48381ddd6 None admin] PATH_INFO: `/v3/roles` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:42:36.422664 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b369d0bc-2ad4-40f8-ab3e-e4e48381ddd6 None admin] RBAC: Adding query filter params (name=service) {{(pid=87055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:42:36.422967 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b369d0bc-2ad4-40f8-ab3e-e4e48381ddd6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:42:36.424422 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b369d0bc-2ad4-40f8-ab3e-e4e48381ddd6 None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:42:36.434505 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 606/1236] 10.222.0.93 () {56 vars in 1103 bytes} [Tue Jul 26 14:42:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:42:36.441192 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b563d5-ab8f-41c0-9f8c-2c4043c82c13 None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:42:36.546998 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:42:36.577902 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b563d5-ab8f-41c0-9f8c-2c4043c82c13 None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:42:36.625454 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0b3382-58ba-4f64-bf76-433ec4beee1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:42:36.626574 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0b3382-58ba-4f64-bf76-433ec4beee1a None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:42:36.627058 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0b3382-58ba-4f64-bf76-433ec4beee1a None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:42:36.627679 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0b3382-58ba-4f64-bf76-433ec4beee1a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:42:36.647618 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0b3382-58ba-4f64-bf76-433ec4beee1a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:42:36.650566 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0b3382-58ba-4f64-bf76-433ec4beee1a None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:42:36.680581 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application [None req-dc0b3382-58ba-4f64-bf76-433ec4beee1a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:42:36.680581 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:42:36.680581 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:42:36.680581 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:42:36.680581 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:42:36.680581 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:42:36.680581 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:42:36.680581 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:42:36.680581 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:42:36.680581 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:42:36.680581 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:42:36.680581 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:42:36.680581 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 14:42:36.680581 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 14:42:36.680581 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 14:42:36.681773 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 14:42:36.681773 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:42:36.681773 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:42:36.681773 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:42:36.681773 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:42:36.681773 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:42:36.681773 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:42:36.681773 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:42:36.681773 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application with Lock( Jul 26 14:42:36.681773 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:42:36.681773 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:42:36.681773 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:42:36.681773 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:42:36.681773 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:42:36.681773 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:42:36.681773 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:42:36.681773 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:42:36.682982 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 14:42:36.682982 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 14:42:36.682982 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:42:36.682982 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Jul 26 14:42:36.682982 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 631/1237] 10.222.0.93 () {56 vars in 1108 bytes} [Tue Jul 26 14:42:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:42:36.689609 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b369d0bc-2ad4-40f8-ab3e-e4e48381ddd6 None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:42:36.823609 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b369d0bc-2ad4-40f8-ab3e-e4e48381ddd6 None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:42:36.835559 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:42:36.864123 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ba4aaf-c8f5-40c0-ae47-c6bc109c1856 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:42:36.866560 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ba4aaf-c8f5-40c0-ae47-c6bc109c1856 None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:42:36.866560 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ba4aaf-c8f5-40c0-ae47-c6bc109c1856 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:42:36.866560 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ba4aaf-c8f5-40c0-ae47-c6bc109c1856 None admin] PATH_INFO: `/v3/domains` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:42:36.866560 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ba4aaf-c8f5-40c0-ae47-c6bc109c1856 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:42:36.866560 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ba4aaf-c8f5-40c0-ae47-c6bc109c1856 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:42:36.867749 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ba4aaf-c8f5-40c0-ae47-c6bc109c1856 None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:42:36.882109 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 607/1238] 10.222.0.93 () {56 vars in 1109 bytes} [Tue Jul 26 14:42:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:42:36.889450 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0b3382-58ba-4f64-bf76-433ec4beee1a None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:42:37.053344 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0b3382-58ba-4f64-bf76-433ec4beee1a None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:42:37.094684 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d0a85c-9c0c-4455-8897-edbcc94cc49d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:42:37.095269 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d0a85c-9c0c-4455-8897-edbcc94cc49d None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:42:37.095550 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d0a85c-9c0c-4455-8897-edbcc94cc49d None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:42:37.095828 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d0a85c-9c0c-4455-8897-edbcc94cc49d None admin] PATH_INFO: `/v3/users/placement` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:42:37.099370 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:42:37.106696 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d0a85c-9c0c-4455-8897-edbcc94cc49d None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:42:37.109035 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d0a85c-9c0c-4455-8897-edbcc94cc49d None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:42:37.123115 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application [None req-58d0a85c-9c0c-4455-8897-edbcc94cc49d None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 26 14:42:37.123115 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:42:37.123115 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:42:37.123115 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:42:37.123115 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:42:37.123115 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:42:37.123115 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:42:37.123115 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:42:37.123115 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:42:37.123115 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:42:37.123115 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:42:37.123115 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:42:37.123115 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 14:42:37.123115 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 14:42:37.123115 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 14:42:37.123115 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 14:42:37.126434 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:42:37.126434 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:42:37.126434 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 14:42:37.126434 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 14:42:37.126434 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 14:42:37.126434 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 14:42:37.126434 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:42:37.126434 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:42:37.126434 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:42:37.126434 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:42:37.126434 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:42:37.126434 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application with Lock( Jul 26 14:42:37.126434 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:42:37.126434 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:42:37.126434 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:42:37.126434 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:42:37.126434 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:42:37.126434 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:42:37.127549 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:42:37.127549 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:42:37.127549 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 14:42:37.127549 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 14:42:37.127549 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 14:42:37.127549 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 14:42:37.127549 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 14:42:37.127549 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 14:42:37.127549 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 26 14:42:37.127549 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Jul 26 14:42:37.127549 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 632/1239] 10.222.0.93 () {56 vars in 1108 bytes} [Tue Jul 26 14:42:36 2022] GET /identity/v3/users/placement => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:42:37.131533 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ba4aaf-c8f5-40c0-ae47-c6bc109c1856 None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:42:37.269574 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ba4aaf-c8f5-40c0-ae47-c6bc109c1856 None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:42:37.308070 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a75824-8d78-4474-80b8-1fde7470b045 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:42:37.308691 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a75824-8d78-4474-80b8-1fde7470b045 None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:42:37.309740 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a75824-8d78-4474-80b8-1fde7470b045 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:42:37.309897 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a75824-8d78-4474-80b8-1fde7470b045 None admin] PATH_INFO: `/v3/users` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:42:37.310718 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a75824-8d78-4474-80b8-1fde7470b045 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:42:37.311032 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a75824-8d78-4474-80b8-1fde7470b045 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:42:37.312469 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a75824-8d78-4474-80b8-1fde7470b045 None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:42:37.332108 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 608/1240] 10.222.0.93 () {56 vars in 1143 bytes} [Tue Jul 26 14:42:37 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:42:37.338663 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d0a85c-9c0c-4455-8897-edbcc94cc49d None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:42:37.462857 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d0a85c-9c0c-4455-8897-edbcc94cc49d None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:42:37.505043 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ded19f-b2b4-4f4b-ba01-f1586d965eb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:42:37.505678 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ded19f-b2b4-4f4b-ba01-f1586d965eb4 None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:42:37.505959 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ded19f-b2b4-4f4b-ba01-f1586d965eb4 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:42:37.506234 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ded19f-b2b4-4f4b-ba01-f1586d965eb4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:42:37.576387 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:42:37.583852 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ded19f-b2b4-4f4b-ba01-f1586d965eb4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:42:37.585526 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ded19f-b2b4-4f4b-ba01-f1586d965eb4 None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:42:37.711622 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 633/1241] 10.222.0.93 () {58 vars in 1282 bytes} [Tue Jul 26 14:42:37 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 26 14:42:37.725051 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a75824-8d78-4474-80b8-1fde7470b045 None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:42:37.756754 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:42:37.843424 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a75824-8d78-4474-80b8-1fde7470b045 None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:42:37.882219 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693d9f55-1359-4610-a612-7394aa631c54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:42:37.882903 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693d9f55-1359-4610-a612-7394aa631c54 None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:42:37.883187 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693d9f55-1359-4610-a612-7394aa631c54 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:42:37.883470 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693d9f55-1359-4610-a612-7394aa631c54 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:42:37.895710 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693d9f55-1359-4610-a612-7394aa631c54 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:42:37.897246 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693d9f55-1359-4610-a612-7394aa631c54 None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:42:37.922812 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application [None req-693d9f55-1359-4610-a612-7394aa631c54 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:42:37.922812 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:42:37.922812 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:42:37.922812 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:42:37.922812 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:42:37.922812 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:42:37.922812 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:42:37.922812 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:42:37.922812 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:42:37.922812 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:42:37.922812 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:42:37.922812 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:42:37.922812 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 14:42:37.922812 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 14:42:37.922812 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 14:42:37.924117 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 14:42:37.924117 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:42:37.924117 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:42:37.924117 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:42:37.924117 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:42:37.924117 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:42:37.924117 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:42:37.924117 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:42:37.924117 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application with Lock( Jul 26 14:42:37.924117 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:42:37.924117 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:42:37.924117 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:42:37.924117 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:42:37.924117 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:42:37.924117 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:42:37.924117 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:42:37.924117 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:42:37.926582 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 14:42:37.926582 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 14:42:37.926582 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:42:37.926582 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Jul 26 14:42:37.926582 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 609/1242] 10.222.0.93 () {56 vars in 1108 bytes} [Tue Jul 26 14:42:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:42:37.932874 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ded19f-b2b4-4f4b-ba01-f1586d965eb4 None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:42:38.078359 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:42:38.084782 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ded19f-b2b4-4f4b-ba01-f1586d965eb4 None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:42:38.122835 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0666f3-e264-4475-8fed-e3f1e75f8126 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:42:38.123612 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0666f3-e264-4475-8fed-e3f1e75f8126 None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:42:38.123981 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0666f3-e264-4475-8fed-e3f1e75f8126 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:42:38.124343 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0666f3-e264-4475-8fed-e3f1e75f8126 None admin] PATH_INFO: `/v3/domains` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:42:38.125148 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0666f3-e264-4475-8fed-e3f1e75f8126 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:42:38.125679 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0666f3-e264-4475-8fed-e3f1e75f8126 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:42:38.127376 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0666f3-e264-4475-8fed-e3f1e75f8126 None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:42:38.140499 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 634/1243] 10.222.0.93 () {56 vars in 1109 bytes} [Tue Jul 26 14:42:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:42:38.146531 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693d9f55-1359-4610-a612-7394aa631c54 None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:42:38.246509 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:42:38.270663 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693d9f55-1359-4610-a612-7394aa631c54 None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:42:38.307567 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06761190-0241-4b55-88b2-204e2b556030 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:42:38.308223 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06761190-0241-4b55-88b2-204e2b556030 None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:42:38.308504 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06761190-0241-4b55-88b2-204e2b556030 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:42:38.308781 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06761190-0241-4b55-88b2-204e2b556030 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:42:38.316429 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06761190-0241-4b55-88b2-204e2b556030 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:42:38.317891 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06761190-0241-4b55-88b2-204e2b556030 None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:42:38.330355 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application [None req-06761190-0241-4b55-88b2-204e2b556030 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 14:42:38.330355 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:42:38.330355 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:42:38.330355 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:42:38.330355 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:42:38.330355 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:42:38.330355 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:42:38.330355 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:42:38.330355 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:42:38.330355 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:42:38.330355 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:42:38.330355 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:42:38.330355 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 14:42:38.330355 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 14:42:38.330355 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 14:42:38.331477 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 14:42:38.331477 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:42:38.331477 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:42:38.331477 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:42:38.331477 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:42:38.331477 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:42:38.331477 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:42:38.331477 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:42:38.331477 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application with Lock( Jul 26 14:42:38.331477 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:42:38.331477 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:42:38.331477 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:42:38.331477 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:42:38.331477 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:42:38.331477 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:42:38.331477 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:42:38.331477 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:42:38.332430 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 14:42:38.332430 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 14:42:38.332430 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 14:42:38.332430 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 14:42:38.332430 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 14:42:38.332430 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 14:42:38.332430 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 14:42:38.332430 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Jul 26 14:42:38.332430 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 610/1244] 10.222.0.93 () {56 vars in 1111 bytes} [Tue Jul 26 14:42:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:42:38.338147 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0666f3-e264-4475-8fed-e3f1e75f8126 None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:42:38.472508 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0666f3-e264-4475-8fed-e3f1e75f8126 None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:42:38.513326 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d668abc1-0a0d-4202-9f07-7f5b1495f666 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:42:38.513969 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d668abc1-0a0d-4202-9f07-7f5b1495f666 None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:42:38.514282 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d668abc1-0a0d-4202-9f07-7f5b1495f666 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:42:38.514563 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d668abc1-0a0d-4202-9f07-7f5b1495f666 None admin] PATH_INFO: `/v3/projects` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:42:38.515333 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d668abc1-0a0d-4202-9f07-7f5b1495f666 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:42:38.515640 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d668abc1-0a0d-4202-9f07-7f5b1495f666 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:42:38.517221 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d668abc1-0a0d-4202-9f07-7f5b1495f666 None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:42:38.531210 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 635/1245] 10.222.0.93 () {56 vars in 1148 bytes} [Tue Jul 26 14:42:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:42:38.537580 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06761190-0241-4b55-88b2-204e2b556030 None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:42:38.662061 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06761190-0241-4b55-88b2-204e2b556030 None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:42:38.705396 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce7752d-d69c-42af-abfb-1d536ca00939 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:42:38.706031 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce7752d-d69c-42af-abfb-1d536ca00939 None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:42:38.706349 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce7752d-d69c-42af-abfb-1d536ca00939 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:42:38.706626 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce7752d-d69c-42af-abfb-1d536ca00939 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:42:38.707638 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce7752d-d69c-42af-abfb-1d536ca00939 None admin] RBAC: Adding query filter params (role.id=2e45ca312cda4bef9263725ae1c6dab7, scope.project.id=c422a2290a14424da20e2841cbc1741d, user.id=3e27fe21cc6048d5b9899b938d84ba5f) {{(pid=87055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:42:38.707954 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce7752d-d69c-42af-abfb-1d536ca00939 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:42:38.709456 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce7752d-d69c-42af-abfb-1d536ca00939 None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:42:38.717547 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 611/1246] 10.222.0.93 () {56 vars in 1374 bytes} [Tue Jul 26 14:42:38 2022] GET /identity/v3/role_assignments?user.id=3e27fe21cc6048d5b9899b938d84ba5f&scope.project.id=c422a2290a14424da20e2841cbc1741d&role.id=2e45ca312cda4bef9263725ae1c6dab7 => generated 608 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:42:41.201224 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48d18a4-d08f-480f-af1e-63c2e9f5d21e None None] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:42:41.210595 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48d18a4-d08f-480f-af1e-63c2e9f5d21e None None] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:42:41.210595 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48d18a4-d08f-480f-af1e-63c2e9f5d21e None None] PATH_INFO: `/` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:42:41.210595 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 636/1247] 10.222.0.93 () {54 vars in 926 bytes} [Tue Jul 26 14:42:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:42:41.210982 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b30a8c2-a69f-4329-99ab-d6080842011c None None] REQUEST_METHOD: `POST` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:42:41.210982 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b30a8c2-a69f-4329-99ab-d6080842011c None None] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:42:41.210982 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b30a8c2-a69f-4329-99ab-d6080842011c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:42:41.220993 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:42:41.242677 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.auth.core [None req-8b30a8c2-a69f-4329-99ab-d6080842011c None None] MFA Rules not processed for user `e5ef88cc058f425b882bcb87a1e1e75c`. Rule list: `[]` (Enabled: `True`). {{(pid=87055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:42:41.244842 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.fernet_utils [None req-8b30a8c2-a69f-4329-99ab-d6080842011c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:42:41.375183 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 612/1248] 10.222.0.93 () {58 vars in 1023 bytes} [Tue Jul 26 14:42:41 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 26 14:42:41.400021 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48d18a4-d08f-480f-af1e-63c2e9f5d21e None None] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:42:41.435206 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:42:41.595801 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48d18a4-d08f-480f-af1e-63c2e9f5d21e None None] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:42:41.661011 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9fdf80-90e7-4d6e-a61f-7b6be63c5b21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:42:41.661774 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9fdf80-90e7-4d6e-a61f-7b6be63c5b21 None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:42:41.662166 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9fdf80-90e7-4d6e-a61f-7b6be63c5b21 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:42:41.662540 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9fdf80-90e7-4d6e-a61f-7b6be63c5b21 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:42:41.687224 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9fdf80-90e7-4d6e-a61f-7b6be63c5b21 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 14:42:41.695907 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application [None req-ec9fdf80-90e7-4d6e-a61f-7b6be63c5b21 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 14:42:41.695907 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:42:41.695907 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:42:41.695907 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:42:41.695907 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:42:41.695907 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:42:41.695907 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:42:41.695907 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:42:41.695907 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:42:41.695907 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:42:41.695907 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:42:41.695907 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:42:41.695907 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 14:42:41.695907 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 14:42:41.695907 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 14:42:41.695907 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 14:42:41.697217 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 14:42:41.697217 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 14:42:41.697217 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 14:42:41.697217 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 14:42:41.697217 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:42:41.697217 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:42:41.697217 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:42:41.697217 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:42:41.697217 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:42:41.697217 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:42:41.697217 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:42:41.697217 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application with Lock( Jul 26 14:42:41.697217 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:42:41.697217 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:42:41.697217 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:42:41.697217 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:42:41.698393 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:42:41.698393 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:42:41.698393 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:42:41.698393 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:42:41.698393 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 14:42:41.698393 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 14:42:41.698393 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 14:42:41.698393 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 14:42:41.698393 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 14:42:41.698393 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 14:42:41.698393 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 14:42:41.698393 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Jul 26 14:42:41.698393 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 637/1249] 10.222.0.93 () {56 vars in 1096 bytes} [Tue Jul 26 14:42:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:42:41.700879 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b30a8c2-a69f-4329-99ab-d6080842011c None None] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:42:41.829101 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b30a8c2-a69f-4329-99ab-d6080842011c None None] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:42:41.866746 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:42:41.872464 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15282f6e-752b-4d08-9aa5-c064b57508b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:42:41.873349 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15282f6e-752b-4d08-9aa5-c064b57508b2 None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:42:41.873804 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15282f6e-752b-4d08-9aa5-c064b57508b2 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:42:41.874263 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15282f6e-752b-4d08-9aa5-c064b57508b2 None admin] PATH_INFO: `/v3/roles` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:42:41.875134 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15282f6e-752b-4d08-9aa5-c064b57508b2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:42:41.875499 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15282f6e-752b-4d08-9aa5-c064b57508b2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:42:41.876997 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15282f6e-752b-4d08-9aa5-c064b57508b2 None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:42:41.887552 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 613/1250] 10.222.0.93 () {56 vars in 1099 bytes} [Tue Jul 26 14:42:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:42:41.894224 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9fdf80-90e7-4d6e-a61f-7b6be63c5b21 None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:42:41.991457 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:42:42.020442 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9fdf80-90e7-4d6e-a61f-7b6be63c5b21 None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:42:42.061187 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14c41d3-6125-4c48-8f0c-68b668899561 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:42:42.064709 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14c41d3-6125-4c48-8f0c-68b668899561 None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:42:42.064709 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14c41d3-6125-4c48-8f0c-68b668899561 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:42:42.064709 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14c41d3-6125-4c48-8f0c-68b668899561 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:42:42.075243 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14c41d3-6125-4c48-8f0c-68b668899561 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:42:42.077043 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14c41d3-6125-4c48-8f0c-68b668899561 None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:42:42.096317 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application [None req-c14c41d3-6125-4c48-8f0c-68b668899561 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:42:42.096317 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:42:42.096317 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:42:42.096317 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:42:42.096317 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:42:42.096317 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:42:42.096317 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:42:42.096317 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:42:42.096317 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:42:42.096317 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:42:42.096317 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:42:42.096317 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:42:42.096317 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 14:42:42.096317 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 14:42:42.096317 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 14:42:42.098070 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 14:42:42.098070 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:42:42.098070 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:42:42.098070 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:42:42.098070 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:42:42.098070 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:42:42.098070 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:42:42.098070 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:42:42.098070 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application with Lock( Jul 26 14:42:42.098070 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:42:42.098070 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:42:42.098070 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:42:42.098070 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:42:42.098070 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:42:42.098070 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:42:42.098070 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:42:42.098070 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:42:42.100058 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 14:42:42.100058 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 14:42:42.100058 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:42:42.100058 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Jul 26 14:42:42.100058 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 638/1251] 10.222.0.93 () {56 vars in 1108 bytes} [Tue Jul 26 14:42:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:42:42.105230 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15282f6e-752b-4d08-9aa5-c064b57508b2 None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:42:42.228255 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15282f6e-752b-4d08-9aa5-c064b57508b2 None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:42:42.284286 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581b6864-ec1b-48eb-85e6-1a089f125526 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:42:42.285328 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581b6864-ec1b-48eb-85e6-1a089f125526 None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:42:42.285820 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581b6864-ec1b-48eb-85e6-1a089f125526 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:42:42.286364 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581b6864-ec1b-48eb-85e6-1a089f125526 None admin] PATH_INFO: `/v3/domains` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:42:42.287715 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581b6864-ec1b-48eb-85e6-1a089f125526 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:42:42.288253 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581b6864-ec1b-48eb-85e6-1a089f125526 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:42:42.290528 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581b6864-ec1b-48eb-85e6-1a089f125526 None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:42:42.315417 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 614/1252] 10.222.0.93 () {56 vars in 1109 bytes} [Tue Jul 26 14:42:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:42:42.321832 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14c41d3-6125-4c48-8f0c-68b668899561 None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:42:42.450769 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14c41d3-6125-4c48-8f0c-68b668899561 None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:42:42.483641 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:42:42.497219 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997f5a44-770d-444a-a337-d55f8371c172 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:42:42.498412 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997f5a44-770d-444a-a337-d55f8371c172 None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:42:42.498869 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997f5a44-770d-444a-a337-d55f8371c172 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:42:42.499334 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997f5a44-770d-444a-a337-d55f8371c172 None admin] PATH_INFO: `/v3/users/placement` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:42:42.508579 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997f5a44-770d-444a-a337-d55f8371c172 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:42:42.509977 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997f5a44-770d-444a-a337-d55f8371c172 None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:42:42.522711 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application [None req-997f5a44-770d-444a-a337-d55f8371c172 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 26 14:42:42.522711 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:42:42.522711 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:42:42.522711 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:42:42.522711 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:42:42.522711 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:42:42.522711 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:42:42.522711 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:42:42.522711 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:42:42.522711 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:42:42.522711 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:42:42.522711 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:42:42.522711 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 14:42:42.522711 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 14:42:42.522711 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 14:42:42.522711 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 14:42:42.524189 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:42:42.524189 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:42:42.524189 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 14:42:42.524189 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 14:42:42.524189 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 14:42:42.524189 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 14:42:42.524189 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:42:42.524189 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:42:42.524189 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:42:42.524189 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:42:42.524189 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:42:42.524189 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application with Lock( Jul 26 14:42:42.524189 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:42:42.524189 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:42:42.524189 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:42:42.524189 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:42:42.524189 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:42:42.524189 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:42:42.525935 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:42:42.525935 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:42:42.525935 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 14:42:42.525935 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 14:42:42.525935 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 14:42:42.525935 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 14:42:42.525935 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 14:42:42.525935 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 14:42:42.525935 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 26 14:42:42.525935 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Jul 26 14:42:42.525935 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 639/1253] 10.222.0.93 () {56 vars in 1108 bytes} [Tue Jul 26 14:42:42 2022] GET /identity/v3/users/placement => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 14:42:42.531838 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581b6864-ec1b-48eb-85e6-1a089f125526 None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:42:42.597294 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:42:42.653128 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581b6864-ec1b-48eb-85e6-1a089f125526 None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:42:42.694792 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33225ef0-af45-4422-8bdf-15586bf92792 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:42:42.695442 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33225ef0-af45-4422-8bdf-15586bf92792 None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:42:42.696434 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33225ef0-af45-4422-8bdf-15586bf92792 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:42:42.696434 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33225ef0-af45-4422-8bdf-15586bf92792 None admin] PATH_INFO: `/v3/users` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:42:42.696841 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33225ef0-af45-4422-8bdf-15586bf92792 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:42:42.697163 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33225ef0-af45-4422-8bdf-15586bf92792 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:42:42.698896 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33225ef0-af45-4422-8bdf-15586bf92792 None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:42:42.725382 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 615/1254] 10.222.0.93 () {56 vars in 1143 bytes} [Tue Jul 26 14:42:42 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:42:42.732093 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997f5a44-770d-444a-a337-d55f8371c172 None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:42:42.864792 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997f5a44-770d-444a-a337-d55f8371c172 None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:42:42.909981 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6353dd5-7283-42f6-ae1e-df7c757747c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:42:42.910655 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6353dd5-7283-42f6-ae1e-df7c757747c1 None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:42:42.910934 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6353dd5-7283-42f6-ae1e-df7c757747c1 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:42:42.911207 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6353dd5-7283-42f6-ae1e-df7c757747c1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:42:42.981510 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:42:42.996027 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6353dd5-7283-42f6-ae1e-df7c757747c1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:42:42.998198 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6353dd5-7283-42f6-ae1e-df7c757747c1 None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:42:43.122495 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 640/1255] 10.222.0.93 () {58 vars in 1282 bytes} [Tue Jul 26 14:42:42 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 26 14:42:43.129109 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33225ef0-af45-4422-8bdf-15586bf92792 None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:42:43.256624 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33225ef0-af45-4422-8bdf-15586bf92792 None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:42:43.273446 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:42:43.299146 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2070ae-f9f2-4ffb-82c2-455140b2fe9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:42:43.299887 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2070ae-f9f2-4ffb-82c2-455140b2fe9c None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:42:43.300167 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2070ae-f9f2-4ffb-82c2-455140b2fe9c None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:42:43.300440 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2070ae-f9f2-4ffb-82c2-455140b2fe9c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:42:43.312704 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2070ae-f9f2-4ffb-82c2-455140b2fe9c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:42:43.314279 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2070ae-f9f2-4ffb-82c2-455140b2fe9c None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:42:43.332101 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application [None req-3d2070ae-f9f2-4ffb-82c2-455140b2fe9c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:42:43.332101 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:42:43.332101 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:42:43.332101 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:42:43.332101 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:42:43.332101 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:42:43.332101 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:42:43.332101 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:42:43.332101 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:42:43.332101 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:42:43.332101 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:42:43.332101 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:42:43.332101 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 14:42:43.332101 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 14:42:43.332101 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 14:42:43.333884 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 14:42:43.333884 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:42:43.333884 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:42:43.333884 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:42:43.333884 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:42:43.333884 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:42:43.333884 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:42:43.333884 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:42:43.333884 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application with Lock( Jul 26 14:42:43.333884 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:42:43.333884 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:42:43.333884 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:42:43.333884 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:42:43.333884 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:42:43.333884 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:42:43.333884 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:42:43.333884 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:42:43.335681 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 14:42:43.335681 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 14:42:43.335681 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:42:43.335681 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Jul 26 14:42:43.338509 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 616/1256] 10.222.0.93 () {56 vars in 1108 bytes} [Tue Jul 26 14:42:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:42:43.340224 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6353dd5-7283-42f6-ae1e-df7c757747c1 None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:42:43.446141 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:42:43.460368 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6353dd5-7283-42f6-ae1e-df7c757747c1 None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:42:43.499388 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682516b1-1d7d-45b8-a58d-0cf5f28430c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:42:43.500018 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682516b1-1d7d-45b8-a58d-0cf5f28430c5 None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:42:43.500302 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682516b1-1d7d-45b8-a58d-0cf5f28430c5 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:42:43.500580 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682516b1-1d7d-45b8-a58d-0cf5f28430c5 None admin] PATH_INFO: `/v3/domains` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:42:43.501374 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682516b1-1d7d-45b8-a58d-0cf5f28430c5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:42:43.501682 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682516b1-1d7d-45b8-a58d-0cf5f28430c5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:42:43.503127 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682516b1-1d7d-45b8-a58d-0cf5f28430c5 None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:42:43.516715 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 641/1257] 10.222.0.93 () {56 vars in 1109 bytes} [Tue Jul 26 14:42:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:42:43.525872 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2070ae-f9f2-4ffb-82c2-455140b2fe9c None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:42:43.641013 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2070ae-f9f2-4ffb-82c2-455140b2fe9c None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:42:43.680940 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf66382c-ac9b-4376-a07d-c5c5840af078 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:42:43.681802 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf66382c-ac9b-4376-a07d-c5c5840af078 None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:42:43.682198 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf66382c-ac9b-4376-a07d-c5c5840af078 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:42:43.682551 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf66382c-ac9b-4376-a07d-c5c5840af078 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:42:43.692617 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf66382c-ac9b-4376-a07d-c5c5840af078 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:42:43.694529 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf66382c-ac9b-4376-a07d-c5c5840af078 None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:42:43.708084 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application [None req-cf66382c-ac9b-4376-a07d-c5c5840af078 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 14:42:43.708084 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:42:43.708084 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:42:43.708084 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:42:43.708084 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:42:43.708084 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:42:43.708084 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:42:43.708084 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:42:43.708084 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:42:43.708084 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:42:43.708084 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:42:43.708084 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:42:43.708084 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 14:42:43.708084 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 14:42:43.708084 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 14:42:43.714275 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 14:42:43.714275 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:42:43.714275 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:42:43.714275 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:42:43.714275 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:42:43.714275 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:42:43.714275 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:42:43.714275 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:42:43.714275 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application with Lock( Jul 26 14:42:43.714275 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:42:43.714275 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:42:43.714275 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:42:43.714275 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:42:43.714275 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:42:43.714275 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:42:43.714275 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:42:43.714275 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:42:43.716565 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 14:42:43.716565 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 14:42:43.716565 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 14:42:43.716565 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 14:42:43.716565 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 14:42:43.716565 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 14:42:43.716565 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 14:42:43.716565 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Jul 26 14:42:43.716565 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 617/1258] 10.222.0.93 () {56 vars in 1111 bytes} [Tue Jul 26 14:42:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:42:43.717468 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682516b1-1d7d-45b8-a58d-0cf5f28430c5 None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:42:43.838793 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682516b1-1d7d-45b8-a58d-0cf5f28430c5 None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:42:43.885983 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611ba2bf-91ef-4126-b2e0-18138a56176d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:42:43.886665 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611ba2bf-91ef-4126-b2e0-18138a56176d None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:42:43.886993 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611ba2bf-91ef-4126-b2e0-18138a56176d None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:42:43.887271 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611ba2bf-91ef-4126-b2e0-18138a56176d None admin] PATH_INFO: `/v3/projects` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:42:43.888052 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611ba2bf-91ef-4126-b2e0-18138a56176d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:42:43.888362 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611ba2bf-91ef-4126-b2e0-18138a56176d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:42:43.889900 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611ba2bf-91ef-4126-b2e0-18138a56176d None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:42:43.904320 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 642/1259] 10.222.0.93 () {56 vars in 1148 bytes} [Tue Jul 26 14:42:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:42:43.911402 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf66382c-ac9b-4376-a07d-c5c5840af078 None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:42:43.942344 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:42:44.025008 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf66382c-ac9b-4376-a07d-c5c5840af078 None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:42:44.079489 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d0bef6-df6a-40c2-a4a1-47d76bd3b8d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:42:44.080136 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d0bef6-df6a-40c2-a4a1-47d76bd3b8d8 None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:42:44.080447 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d0bef6-df6a-40c2-a4a1-47d76bd3b8d8 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:42:44.080726 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d0bef6-df6a-40c2-a4a1-47d76bd3b8d8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:42:44.081534 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d0bef6-df6a-40c2-a4a1-47d76bd3b8d8 None admin] RBAC: Adding query filter params (role.id=94e105ff8ee4486abd501415cc05ba38, scope.project.id=c422a2290a14424da20e2841cbc1741d, user.id=3e27fe21cc6048d5b9899b938d84ba5f) {{(pid=87055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:42:44.081954 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d0bef6-df6a-40c2-a4a1-47d76bd3b8d8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:42:44.083499 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d0bef6-df6a-40c2-a4a1-47d76bd3b8d8 None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:42:44.090364 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 618/1260] 10.222.0.93 () {56 vars in 1374 bytes} [Tue Jul 26 14:42:43 2022] GET /identity/v3/role_assignments?user.id=3e27fe21cc6048d5b9899b938d84ba5f&scope.project.id=c422a2290a14424da20e2841cbc1741d&role.id=94e105ff8ee4486abd501415cc05ba38 => generated 259 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:42:46.214759 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098c8741-0d38-4c1a-99ed-03993bfd794b None None] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:42:46.215341 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098c8741-0d38-4c1a-99ed-03993bfd794b None None] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:42:46.215341 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098c8741-0d38-4c1a-99ed-03993bfd794b None None] PATH_INFO: `/` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:42:46.216738 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 643/1261] 10.222.0.93 () {54 vars in 926 bytes} [Tue Jul 26 14:42:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 14:42:46.225110 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da52dab0-f053-4f23-a3ee-533e9cf71460 None None] REQUEST_METHOD: `POST` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:42:46.225713 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da52dab0-f053-4f23-a3ee-533e9cf71460 None None] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:42:46.225713 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da52dab0-f053-4f23-a3ee-533e9cf71460 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:42:46.245456 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.auth.core [None req-da52dab0-f053-4f23-a3ee-533e9cf71460 None None] MFA Rules not processed for user `e5ef88cc058f425b882bcb87a1e1e75c`. Rule list: `[]` (Enabled: `True`). {{(pid=87055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:42:46.247340 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.fernet_utils [None req-da52dab0-f053-4f23-a3ee-533e9cf71460 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:42:46.330406 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 619/1262] 10.222.0.93 () {58 vars in 1023 bytes} [Tue Jul 26 14:42:46 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 26 14:42:46.351663 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098c8741-0d38-4c1a-99ed-03993bfd794b None None] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:42:46.364600 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:42:46.466175 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098c8741-0d38-4c1a-99ed-03993bfd794b None None] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:42:46.504103 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6f95cf-557c-4b32-b68d-3a4f30a04299 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:42:46.504752 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6f95cf-557c-4b32-b68d-3a4f30a04299 None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:42:46.505043 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6f95cf-557c-4b32-b68d-3a4f30a04299 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:42:46.505733 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6f95cf-557c-4b32-b68d-3a4f30a04299 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:42:46.520777 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6f95cf-557c-4b32-b68d-3a4f30a04299 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 14:42:46.527318 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application [None req-6d6f95cf-557c-4b32-b68d-3a4f30a04299 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 14:42:46.527318 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:42:46.527318 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:42:46.527318 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:42:46.527318 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:42:46.527318 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:42:46.527318 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:42:46.527318 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:42:46.527318 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:42:46.527318 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:42:46.527318 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:42:46.527318 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:42:46.527318 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 14:42:46.527318 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 14:42:46.527318 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 14:42:46.527318 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 14:42:46.528783 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 14:42:46.528783 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 14:42:46.528783 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 14:42:46.528783 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 14:42:46.528783 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:42:46.528783 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:42:46.528783 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:42:46.528783 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:42:46.528783 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:42:46.528783 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:42:46.528783 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:42:46.528783 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application with Lock( Jul 26 14:42:46.528783 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:42:46.528783 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:42:46.528783 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:42:46.528783 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:42:46.529821 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:42:46.529821 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:42:46.529821 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:42:46.529821 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:42:46.529821 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 14:42:46.529821 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 14:42:46.529821 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 14:42:46.529821 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 14:42:46.529821 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 14:42:46.529821 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 14:42:46.529821 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 14:42:46.529821 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Jul 26 14:42:46.529821 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 644/1263] 10.222.0.93 () {56 vars in 1096 bytes} [Tue Jul 26 14:42:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:42:46.534175 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da52dab0-f053-4f23-a3ee-533e9cf71460 None None] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:42:46.556817 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:42:46.669358 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da52dab0-f053-4f23-a3ee-533e9cf71460 None None] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:42:46.736886 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f548e313-ab51-4ce9-875a-b05883bdd8f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:42:46.737654 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f548e313-ab51-4ce9-875a-b05883bdd8f4 None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:42:46.738137 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f548e313-ab51-4ce9-875a-b05883bdd8f4 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:42:46.745171 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f548e313-ab51-4ce9-875a-b05883bdd8f4 None admin] PATH_INFO: `/v3/roles` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:42:46.745171 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f548e313-ab51-4ce9-875a-b05883bdd8f4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:42:46.745171 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f548e313-ab51-4ce9-875a-b05883bdd8f4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:42:46.745171 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f548e313-ab51-4ce9-875a-b05883bdd8f4 None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:42:46.757596 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 620/1264] 10.222.0.93 () {56 vars in 1099 bytes} [Tue Jul 26 14:42:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:42:46.764810 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6f95cf-557c-4b32-b68d-3a4f30a04299 None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:42:46.856927 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:42:46.892582 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6f95cf-557c-4b32-b68d-3a4f30a04299 None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:42:46.930935 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7fa79a-132a-438e-9059-b0bebe700643 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:42:46.932397 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7fa79a-132a-438e-9059-b0bebe700643 None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:42:46.932919 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7fa79a-132a-438e-9059-b0bebe700643 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:42:46.933647 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7fa79a-132a-438e-9059-b0bebe700643 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:42:46.953913 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7fa79a-132a-438e-9059-b0bebe700643 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:42:46.956704 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7fa79a-132a-438e-9059-b0bebe700643 None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:42:46.985544 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application [None req-1e7fa79a-132a-438e-9059-b0bebe700643 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:42:46.985544 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:42:46.985544 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:42:46.985544 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:42:46.985544 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:42:46.985544 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:42:46.985544 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:42:46.985544 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:42:46.985544 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:42:46.985544 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:42:46.985544 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:42:46.985544 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:42:46.985544 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 14:42:46.985544 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 14:42:46.985544 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 14:42:46.987538 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 14:42:46.987538 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:42:46.987538 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:42:46.987538 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:42:46.987538 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:42:46.987538 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:42:46.987538 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:42:46.987538 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:42:46.987538 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application with Lock( Jul 26 14:42:46.987538 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:42:46.987538 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:42:46.987538 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:42:46.987538 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:42:46.987538 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:42:46.987538 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:42:46.987538 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:42:46.987538 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:42:46.989507 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 14:42:46.989507 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 14:42:46.989507 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:42:46.989507 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Jul 26 14:42:46.989507 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 645/1265] 10.222.0.93 () {56 vars in 1108 bytes} [Tue Jul 26 14:42:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:42:46.995428 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f548e313-ab51-4ce9-875a-b05883bdd8f4 None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:42:47.105231 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:42:47.129856 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f548e313-ab51-4ce9-875a-b05883bdd8f4 None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:42:47.168398 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f032479-6305-4ceb-82c8-d21a259fe255 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:42:47.169218 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f032479-6305-4ceb-82c8-d21a259fe255 None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:42:47.169524 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f032479-6305-4ceb-82c8-d21a259fe255 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:42:47.169857 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f032479-6305-4ceb-82c8-d21a259fe255 None admin] PATH_INFO: `/v3/domains` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:42:47.170602 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f032479-6305-4ceb-82c8-d21a259fe255 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:42:47.170914 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f032479-6305-4ceb-82c8-d21a259fe255 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:42:47.172303 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f032479-6305-4ceb-82c8-d21a259fe255 None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:42:47.186078 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 621/1266] 10.222.0.93 () {56 vars in 1109 bytes} [Tue Jul 26 14:42:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:42:47.198817 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7fa79a-132a-438e-9059-b0bebe700643 None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:42:47.314346 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7fa79a-132a-438e-9059-b0bebe700643 None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:42:47.337060 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:42:47.352529 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3e257c-e121-4b1f-b6ce-7ad7e905c9d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:42:47.353216 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3e257c-e121-4b1f-b6ce-7ad7e905c9d4 None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:42:47.353497 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3e257c-e121-4b1f-b6ce-7ad7e905c9d4 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:42:47.353771 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3e257c-e121-4b1f-b6ce-7ad7e905c9d4 None admin] PATH_INFO: `/v3/users/placement` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:42:47.362316 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3e257c-e121-4b1f-b6ce-7ad7e905c9d4 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:42:47.363790 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3e257c-e121-4b1f-b6ce-7ad7e905c9d4 None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:42:47.376345 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application [None req-df3e257c-e121-4b1f-b6ce-7ad7e905c9d4 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 26 14:42:47.376345 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:42:47.376345 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:42:47.376345 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:42:47.376345 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:42:47.376345 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:42:47.376345 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:42:47.376345 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:42:47.376345 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:42:47.376345 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:42:47.376345 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:42:47.376345 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:42:47.376345 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 14:42:47.376345 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 14:42:47.376345 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 14:42:47.376345 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 14:42:47.377647 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:42:47.377647 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:42:47.377647 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 14:42:47.377647 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 14:42:47.377647 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 14:42:47.377647 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 14:42:47.377647 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:42:47.377647 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:42:47.377647 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:42:47.377647 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:42:47.377647 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:42:47.377647 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application with Lock( Jul 26 14:42:47.377647 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:42:47.377647 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:42:47.377647 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:42:47.377647 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:42:47.377647 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:42:47.377647 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:42:47.378848 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:42:47.378848 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:42:47.378848 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 14:42:47.378848 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 14:42:47.378848 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 14:42:47.378848 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 14:42:47.378848 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 14:42:47.378848 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 14:42:47.378848 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 26 14:42:47.378848 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Jul 26 14:42:47.378848 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 646/1267] 10.222.0.93 () {56 vars in 1108 bytes} [Tue Jul 26 14:42:47 2022] GET /identity/v3/users/placement => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:42:47.385038 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f032479-6305-4ceb-82c8-d21a259fe255 None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:42:47.499745 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f032479-6305-4ceb-82c8-d21a259fe255 None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:42:47.540243 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d2cebd-bfd1-4348-8193-0c4ae321256a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:42:47.540881 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d2cebd-bfd1-4348-8193-0c4ae321256a None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:42:47.541164 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d2cebd-bfd1-4348-8193-0c4ae321256a None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:42:47.541511 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d2cebd-bfd1-4348-8193-0c4ae321256a None admin] PATH_INFO: `/v3/users` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:42:47.542353 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d2cebd-bfd1-4348-8193-0c4ae321256a None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:42:47.542670 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d2cebd-bfd1-4348-8193-0c4ae321256a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:42:47.544825 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d2cebd-bfd1-4348-8193-0c4ae321256a None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:42:47.555975 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:42:47.567085 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 622/1268] 10.222.0.93 () {56 vars in 1143 bytes} [Tue Jul 26 14:42:47 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:42:47.573375 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3e257c-e121-4b1f-b6ce-7ad7e905c9d4 None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:42:47.688702 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3e257c-e121-4b1f-b6ce-7ad7e905c9d4 None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:42:47.725193 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db9c7a5-5bfb-4394-b882-10d13ce31e81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:42:47.725832 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db9c7a5-5bfb-4394-b882-10d13ce31e81 None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:42:47.726104 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db9c7a5-5bfb-4394-b882-10d13ce31e81 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:42:47.726407 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db9c7a5-5bfb-4394-b882-10d13ce31e81 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:42:47.739532 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db9c7a5-5bfb-4394-b882-10d13ce31e81 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:42:47.740995 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db9c7a5-5bfb-4394-b882-10d13ce31e81 None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:42:47.756968 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application [None req-6db9c7a5-5bfb-4394-b882-10d13ce31e81 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:42:47.756968 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:42:47.756968 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:42:47.756968 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:42:47.756968 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:42:47.756968 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:42:47.756968 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:42:47.756968 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:42:47.756968 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:42:47.756968 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:42:47.756968 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:42:47.756968 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:42:47.756968 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 14:42:47.756968 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 14:42:47.756968 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 14:42:47.758517 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 14:42:47.758517 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:42:47.758517 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:42:47.758517 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:42:47.758517 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:42:47.758517 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:42:47.758517 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:42:47.758517 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:42:47.758517 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application with Lock( Jul 26 14:42:47.758517 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:42:47.758517 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:42:47.758517 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:42:47.758517 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:42:47.758517 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:42:47.758517 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:42:47.758517 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:42:47.758517 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:42:47.759848 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 14:42:47.759848 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 14:42:47.759848 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:42:47.759848 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Jul 26 14:42:47.759848 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 647/1269] 10.222.0.93 () {56 vars in 1108 bytes} [Tue Jul 26 14:42:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 14:42:47.765360 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d2cebd-bfd1-4348-8193-0c4ae321256a None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:42:47.888154 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d2cebd-bfd1-4348-8193-0c4ae321256a None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:42:47.927664 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef28821-0d65-464a-9882-400025a5e32b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:42:47.928294 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef28821-0d65-464a-9882-400025a5e32b None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:42:47.928582 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef28821-0d65-464a-9882-400025a5e32b None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:42:47.928862 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef28821-0d65-464a-9882-400025a5e32b None admin] PATH_INFO: `/v3/domains` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:42:47.929570 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef28821-0d65-464a-9882-400025a5e32b None admin] RBAC: Adding query filter params (name=Default) {{(pid=87055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:42:47.929881 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef28821-0d65-464a-9882-400025a5e32b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:42:47.931331 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef28821-0d65-464a-9882-400025a5e32b None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:42:47.944636 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 623/1270] 10.222.0.93 () {56 vars in 1109 bytes} [Tue Jul 26 14:42:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:42:47.950871 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db9c7a5-5bfb-4394-b882-10d13ce31e81 None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:42:47.988071 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:42:48.078803 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db9c7a5-5bfb-4394-b882-10d13ce31e81 None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:42:48.151309 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b029ea-646d-4848-8983-6155a66bac56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:42:48.151897 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b029ea-646d-4848-8983-6155a66bac56 None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:42:48.152181 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b029ea-646d-4848-8983-6155a66bac56 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:42:48.152460 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b029ea-646d-4848-8983-6155a66bac56 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:42:48.161876 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b029ea-646d-4848-8983-6155a66bac56 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:42:48.163389 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b029ea-646d-4848-8983-6155a66bac56 None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:42:48.176119 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application [None req-81b029ea-646d-4848-8983-6155a66bac56 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 14:42:48.176119 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:42:48.176119 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:42:48.176119 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:42:48.176119 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:42:48.176119 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:42:48.176119 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:42:48.176119 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:42:48.176119 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:42:48.176119 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:42:48.176119 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:42:48.176119 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:42:48.176119 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 14:42:48.176119 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 14:42:48.176119 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 14:42:48.177898 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 14:42:48.177898 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:42:48.177898 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:42:48.177898 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:42:48.177898 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:42:48.177898 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:42:48.177898 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:42:48.177898 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:42:48.177898 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application with Lock( Jul 26 14:42:48.177898 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:42:48.177898 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:42:48.177898 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:42:48.177898 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:42:48.177898 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:42:48.177898 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:42:48.177898 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:42:48.177898 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:42:48.179816 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 14:42:48.179816 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 14:42:48.179816 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 14:42:48.179816 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 14:42:48.179816 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 14:42:48.179816 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 14:42:48.179816 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 14:42:48.179816 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Jul 26 14:42:48.179816 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 648/1271] 10.222.0.93 () {56 vars in 1111 bytes} [Tue Jul 26 14:42:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:42:48.184115 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef28821-0d65-464a-9882-400025a5e32b None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:42:48.254645 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:42:48.299991 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef28821-0d65-464a-9882-400025a5e32b None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:42:48.338747 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc257c68-30a3-4d12-b239-c6e0189b559b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:42:48.339390 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc257c68-30a3-4d12-b239-c6e0189b559b None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:42:48.339702 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc257c68-30a3-4d12-b239-c6e0189b559b None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:42:48.339984 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc257c68-30a3-4d12-b239-c6e0189b559b None admin] PATH_INFO: `/v3/projects` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:42:48.340854 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc257c68-30a3-4d12-b239-c6e0189b559b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:42:48.341166 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc257c68-30a3-4d12-b239-c6e0189b559b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:42:48.342693 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc257c68-30a3-4d12-b239-c6e0189b559b None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:42:48.356830 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 624/1272] 10.222.0.93 () {56 vars in 1148 bytes} [Tue Jul 26 14:42:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:42:48.366892 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b029ea-646d-4848-8983-6155a66bac56 None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:42:48.503538 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:42:48.515539 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b029ea-646d-4848-8983-6155a66bac56 None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:42:48.555964 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fe6079-f794-4c72-ab0a-e91cd76e7cc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:42:48.556665 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fe6079-f794-4c72-ab0a-e91cd76e7cc3 None admin] REQUEST_METHOD: `PUT` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:42:48.556951 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fe6079-f794-4c72-ab0a-e91cd76e7cc3 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:42:48.557234 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fe6079-f794-4c72-ab0a-e91cd76e7cc3 None admin] PATH_INFO: `/v3/projects/c422a2290a14424da20e2841cbc1741d/users/3e27fe21cc6048d5b9899b938d84ba5f/roles/94e105ff8ee4486abd501415cc05ba38` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:42:48.559867 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fe6079-f794-4c72-ab0a-e91cd76e7cc3 None admin] RBAC: Authorizing `identity:create_grant(project_id=c422a2290a14424da20e2841cbc1741d, user_id=3e27fe21cc6048d5b9899b938d84ba5f, role_id=94e105ff8ee4486abd501415cc05ba38)` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:42:48.561399 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fe6079-f794-4c72-ab0a-e91cd76e7cc3 None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:42:48.739760 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 649/1273] 10.222.0.93 () {58 vars in 1439 bytes} [Tue Jul 26 14:42:48 2022] PUT /identity/v3/projects/c422a2290a14424da20e2841cbc1741d/users/3e27fe21cc6048d5b9899b938d84ba5f/roles/94e105ff8ee4486abd501415cc05ba38 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 14:42:50.870350 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dbbc9e-650c-4f2c-96f3-66f6d961f2a7 None None] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:42:50.871017 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dbbc9e-650c-4f2c-96f3-66f6d961f2a7 None None] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:42:50.871017 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dbbc9e-650c-4f2c-96f3-66f6d961f2a7 None None] PATH_INFO: `/` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:42:50.872463 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 625/1274] 10.222.0.93 () {54 vars in 926 bytes} [Tue Jul 26 14:42:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:42:50.878654 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5018a8e-9ab1-4773-95e9-fe92836e0180 None None] REQUEST_METHOD: `POST` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:42:50.879268 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5018a8e-9ab1-4773-95e9-fe92836e0180 None None] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:42:50.879268 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5018a8e-9ab1-4773-95e9-fe92836e0180 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:42:50.900291 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.auth.core [None req-a5018a8e-9ab1-4773-95e9-fe92836e0180 None None] MFA Rules not processed for user `e5ef88cc058f425b882bcb87a1e1e75c`. Rule list: `[]` (Enabled: `True`). {{(pid=87056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:42:50.901648 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.fernet_utils [None req-a5018a8e-9ab1-4773-95e9-fe92836e0180 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:42:51.003006 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 650/1275] 10.222.0.93 () {58 vars in 1023 bytes} [Tue Jul 26 14:42:50 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 14:42:51.026927 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dbbc9e-650c-4f2c-96f3-66f6d961f2a7 None None] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:42:51.201573 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dbbc9e-650c-4f2c-96f3-66f6d961f2a7 None None] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:42:51.224623 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:42:51.244536 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57775f58-85e5-400d-ae87-6d182fd8cdec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:42:51.245204 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57775f58-85e5-400d-ae87-6d182fd8cdec None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:42:51.245502 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57775f58-85e5-400d-ae87-6d182fd8cdec None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:42:51.245770 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57775f58-85e5-400d-ae87-6d182fd8cdec None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:42:51.259992 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57775f58-85e5-400d-ae87-6d182fd8cdec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 14:42:51.265597 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application [None req-57775f58-85e5-400d-ae87-6d182fd8cdec None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 14:42:51.265597 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:42:51.265597 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:42:51.265597 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:42:51.265597 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:42:51.265597 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:42:51.265597 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:42:51.265597 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:42:51.265597 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:42:51.265597 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:42:51.265597 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:42:51.265597 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:42:51.265597 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 14:42:51.265597 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 14:42:51.265597 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 14:42:51.265597 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 14:42:51.267485 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 14:42:51.267485 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 14:42:51.267485 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 14:42:51.267485 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 14:42:51.267485 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:42:51.267485 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:42:51.267485 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:42:51.267485 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:42:51.267485 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:42:51.267485 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:42:51.267485 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:42:51.267485 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application with Lock( Jul 26 14:42:51.267485 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:42:51.267485 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:42:51.267485 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:42:51.267485 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:42:51.268614 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:42:51.268614 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:42:51.268614 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:42:51.268614 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:42:51.268614 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 14:42:51.268614 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 14:42:51.268614 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 14:42:51.268614 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 14:42:51.268614 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 14:42:51.268614 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 14:42:51.268614 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 14:42:51.268614 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Jul 26 14:42:51.268614 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 626/1276] 10.222.0.93 () {56 vars in 1096 bytes} [Tue Jul 26 14:42:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:42:51.273632 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5018a8e-9ab1-4773-95e9-fe92836e0180 None None] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:42:51.369868 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:42:51.396005 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5018a8e-9ab1-4773-95e9-fe92836e0180 None None] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:42:51.445931 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f49bef2-4c8b-46a1-b470-ee3202020308 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:42:51.446616 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f49bef2-4c8b-46a1-b470-ee3202020308 None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:42:51.446898 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f49bef2-4c8b-46a1-b470-ee3202020308 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:42:51.447172 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f49bef2-4c8b-46a1-b470-ee3202020308 None admin] PATH_INFO: `/v3/roles` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:42:51.447906 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f49bef2-4c8b-46a1-b470-ee3202020308 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:42:51.448213 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f49bef2-4c8b-46a1-b470-ee3202020308 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:42:51.449791 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f49bef2-4c8b-46a1-b470-ee3202020308 None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:42:51.459402 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 651/1277] 10.222.0.93 () {56 vars in 1099 bytes} [Tue Jul 26 14:42:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:42:51.466466 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57775f58-85e5-400d-ae87-6d182fd8cdec None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:42:51.591242 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57775f58-85e5-400d-ae87-6d182fd8cdec None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:42:51.640330 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26275c5f-2bc5-4205-8e3c-26bb3a9b9932 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:42:51.641419 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26275c5f-2bc5-4205-8e3c-26bb3a9b9932 None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:42:51.641893 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26275c5f-2bc5-4205-8e3c-26bb3a9b9932 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:42:51.642405 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26275c5f-2bc5-4205-8e3c-26bb3a9b9932 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:42:51.656259 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26275c5f-2bc5-4205-8e3c-26bb3a9b9932 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:42:51.657759 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26275c5f-2bc5-4205-8e3c-26bb3a9b9932 None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:42:51.674907 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application [None req-26275c5f-2bc5-4205-8e3c-26bb3a9b9932 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:42:51.674907 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:42:51.674907 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:42:51.674907 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:42:51.674907 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:42:51.674907 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:42:51.674907 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:42:51.674907 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:42:51.674907 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:42:51.674907 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:42:51.674907 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:42:51.674907 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:42:51.674907 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 14:42:51.674907 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 14:42:51.674907 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 14:42:51.676184 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 14:42:51.676184 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:42:51.676184 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:42:51.676184 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:42:51.676184 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:42:51.676184 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:42:51.676184 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:42:51.676184 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:42:51.676184 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application with Lock( Jul 26 14:42:51.676184 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:42:51.676184 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:42:51.676184 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:42:51.676184 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:42:51.676184 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:42:51.676184 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:42:51.676184 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:42:51.676184 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:42:51.677091 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 14:42:51.677091 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 14:42:51.677091 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:42:51.677091 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Jul 26 14:42:51.677091 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 627/1278] 10.222.0.93 () {56 vars in 1108 bytes} [Tue Jul 26 14:42:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:42:51.682578 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f49bef2-4c8b-46a1-b470-ee3202020308 None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:42:51.807083 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f49bef2-4c8b-46a1-b470-ee3202020308 None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:42:51.848434 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc56ee4a-cf8c-4aa2-b879-72981f7c8dbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:42:51.849011 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc56ee4a-cf8c-4aa2-b879-72981f7c8dbb None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:42:51.849289 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc56ee4a-cf8c-4aa2-b879-72981f7c8dbb None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:42:51.849566 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc56ee4a-cf8c-4aa2-b879-72981f7c8dbb None admin] PATH_INFO: `/v3/domains` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:42:51.850307 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc56ee4a-cf8c-4aa2-b879-72981f7c8dbb None admin] RBAC: Adding query filter params (name=Default) {{(pid=87056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:42:51.850601 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc56ee4a-cf8c-4aa2-b879-72981f7c8dbb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:42:51.852042 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc56ee4a-cf8c-4aa2-b879-72981f7c8dbb None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:42:51.868631 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 652/1279] 10.222.0.93 () {56 vars in 1109 bytes} [Tue Jul 26 14:42:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:42:51.875220 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26275c5f-2bc5-4205-8e3c-26bb3a9b9932 None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:42:51.913690 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:42:52.008520 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26275c5f-2bc5-4205-8e3c-26bb3a9b9932 None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:42:52.180535 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b932afe0-7981-4241-a54d-57ce5e00f1ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:42:52.181197 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b932afe0-7981-4241-a54d-57ce5e00f1ad None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:42:52.181558 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b932afe0-7981-4241-a54d-57ce5e00f1ad None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:42:52.181776 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b932afe0-7981-4241-a54d-57ce5e00f1ad None admin] PATH_INFO: `/v3/users/placement` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:42:52.195613 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b932afe0-7981-4241-a54d-57ce5e00f1ad None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:42:52.197505 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b932afe0-7981-4241-a54d-57ce5e00f1ad None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:42:52.212508 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application [None req-b932afe0-7981-4241-a54d-57ce5e00f1ad None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 26 14:42:52.212508 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:42:52.212508 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:42:52.212508 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:42:52.212508 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:42:52.212508 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:42:52.212508 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:42:52.212508 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:42:52.212508 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:42:52.212508 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:42:52.212508 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:42:52.212508 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:42:52.212508 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 14:42:52.212508 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 14:42:52.212508 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 14:42:52.212508 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 14:42:52.214437 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:42:52.214437 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:42:52.214437 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 14:42:52.214437 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 14:42:52.214437 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 14:42:52.214437 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 14:42:52.214437 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:42:52.214437 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:42:52.214437 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:42:52.214437 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:42:52.214437 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:42:52.214437 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application with Lock( Jul 26 14:42:52.214437 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:42:52.214437 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:42:52.214437 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:42:52.214437 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:42:52.214437 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:42:52.214437 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:42:52.216784 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:42:52.216784 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:42:52.216784 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 14:42:52.216784 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 14:42:52.216784 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 14:42:52.216784 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 14:42:52.216784 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 14:42:52.216784 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 14:42:52.216784 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 26 14:42:52.216784 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Jul 26 14:42:52.216784 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 628/1280] 10.222.0.93 () {56 vars in 1108 bytes} [Tue Jul 26 14:42:51 2022] GET /identity/v3/users/placement => generated 87 bytes in 339 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 14:42:52.220987 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc56ee4a-cf8c-4aa2-b879-72981f7c8dbb None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:42:52.225917 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:42:52.358829 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc56ee4a-cf8c-4aa2-b879-72981f7c8dbb None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:42:52.400299 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef7b867-3d2d-474a-b4a9-57fd4e4b2a54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:42:52.400933 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef7b867-3d2d-474a-b4a9-57fd4e4b2a54 None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:42:52.401299 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef7b867-3d2d-474a-b4a9-57fd4e4b2a54 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:42:52.401670 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef7b867-3d2d-474a-b4a9-57fd4e4b2a54 None admin] PATH_INFO: `/v3/users` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:42:52.402749 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef7b867-3d2d-474a-b4a9-57fd4e4b2a54 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:42:52.403264 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef7b867-3d2d-474a-b4a9-57fd4e4b2a54 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:42:52.404736 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef7b867-3d2d-474a-b4a9-57fd4e4b2a54 None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:42:52.430667 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 653/1281] 10.222.0.93 () {56 vars in 1143 bytes} [Tue Jul 26 14:42:52 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:42:52.438467 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b932afe0-7981-4241-a54d-57ce5e00f1ad None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:42:52.548358 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:42:52.564165 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b932afe0-7981-4241-a54d-57ce5e00f1ad None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:42:52.603158 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d68e63-3e73-4125-a788-2636b8d32db7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:42:52.603794 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d68e63-3e73-4125-a788-2636b8d32db7 None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:42:52.604130 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d68e63-3e73-4125-a788-2636b8d32db7 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:42:52.604949 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d68e63-3e73-4125-a788-2636b8d32db7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:42:52.691473 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d68e63-3e73-4125-a788-2636b8d32db7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:42:52.692845 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d68e63-3e73-4125-a788-2636b8d32db7 None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:42:52.822217 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:42:52.835134 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 629/1282] 10.222.0.93 () {58 vars in 1282 bytes} [Tue Jul 26 14:42:52 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 26 14:42:52.843146 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef7b867-3d2d-474a-b4a9-57fd4e4b2a54 None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:42:52.958921 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:42:53.004250 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef7b867-3d2d-474a-b4a9-57fd4e4b2a54 None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:42:53.043947 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807c229b-88ac-49db-9a26-1d15d98eddf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:42:53.044607 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807c229b-88ac-49db-9a26-1d15d98eddf1 None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:42:53.044890 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807c229b-88ac-49db-9a26-1d15d98eddf1 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:42:53.045167 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807c229b-88ac-49db-9a26-1d15d98eddf1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:42:53.058043 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807c229b-88ac-49db-9a26-1d15d98eddf1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:42:53.059934 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807c229b-88ac-49db-9a26-1d15d98eddf1 None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:42:53.082644 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application [None req-807c229b-88ac-49db-9a26-1d15d98eddf1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:42:53.082644 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:42:53.082644 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:42:53.082644 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:42:53.082644 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:42:53.082644 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:42:53.082644 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:42:53.082644 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:42:53.082644 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:42:53.082644 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:42:53.082644 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:42:53.082644 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:42:53.082644 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 14:42:53.082644 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 14:42:53.082644 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 14:42:53.083866 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 14:42:53.083866 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:42:53.083866 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:42:53.083866 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:42:53.083866 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:42:53.083866 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:42:53.083866 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:42:53.083866 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:42:53.083866 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application with Lock( Jul 26 14:42:53.083866 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:42:53.083866 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:42:53.083866 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:42:53.083866 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:42:53.083866 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:42:53.083866 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:42:53.083866 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:42:53.083866 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:42:53.084893 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 14:42:53.084893 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 14:42:53.084893 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 14:42:53.084893 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Jul 26 14:42:53.084893 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 654/1283] 10.222.0.93 () {56 vars in 1108 bytes} [Tue Jul 26 14:42:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:42:53.091876 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d68e63-3e73-4125-a788-2636b8d32db7 None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:42:53.218715 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d68e63-3e73-4125-a788-2636b8d32db7 None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:42:53.262389 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be6715b-14f3-4560-ab36-0cd7aaa82f03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:42:53.263109 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be6715b-14f3-4560-ab36-0cd7aaa82f03 None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:42:53.263392 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be6715b-14f3-4560-ab36-0cd7aaa82f03 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:42:53.263667 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be6715b-14f3-4560-ab36-0cd7aaa82f03 None admin] PATH_INFO: `/v3/domains` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:42:53.264425 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be6715b-14f3-4560-ab36-0cd7aaa82f03 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:42:53.264735 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be6715b-14f3-4560-ab36-0cd7aaa82f03 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:42:53.266110 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be6715b-14f3-4560-ab36-0cd7aaa82f03 None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:42:53.283024 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 630/1284] 10.222.0.93 () {56 vars in 1109 bytes} [Tue Jul 26 14:42:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:42:53.289515 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807c229b-88ac-49db-9a26-1d15d98eddf1 None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:42:53.435029 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807c229b-88ac-49db-9a26-1d15d98eddf1 None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:42:53.451490 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:42:53.473198 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60c9cd4-c523-434a-892d-381093bf5735 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:42:53.473765 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60c9cd4-c523-434a-892d-381093bf5735 None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:42:53.474045 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60c9cd4-c523-434a-892d-381093bf5735 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:42:53.474353 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60c9cd4-c523-434a-892d-381093bf5735 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:42:53.481906 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60c9cd4-c523-434a-892d-381093bf5735 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:42:53.483478 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60c9cd4-c523-434a-892d-381093bf5735 None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:42:53.497776 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application [None req-b60c9cd4-c523-434a-892d-381093bf5735 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 14:42:53.497776 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:42:53.497776 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:42:53.497776 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:42:53.497776 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:42:53.497776 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:42:53.497776 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:42:53.497776 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:42:53.497776 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:42:53.497776 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:42:53.497776 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:42:53.497776 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:42:53.497776 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 14:42:53.497776 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 14:42:53.497776 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 14:42:53.499546 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 14:42:53.499546 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:42:53.499546 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:42:53.499546 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:42:53.499546 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:42:53.499546 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:42:53.499546 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:42:53.499546 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:42:53.499546 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application with Lock( Jul 26 14:42:53.499546 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:42:53.499546 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:42:53.499546 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:42:53.499546 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:42:53.499546 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:42:53.499546 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:42:53.499546 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:42:53.499546 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:42:53.501310 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 14:42:53.501310 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 14:42:53.501310 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 14:42:53.501310 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 14:42:53.501310 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 14:42:53.501310 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 14:42:53.501310 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 14:42:53.501310 dv-cinder-851030-1-smb devstack@keystone.service[87056]: ERROR keystone.server.flask.application Jul 26 14:42:53.501310 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 655/1285] 10.222.0.93 () {56 vars in 1111 bytes} [Tue Jul 26 14:42:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:42:53.505386 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be6715b-14f3-4560-ab36-0cd7aaa82f03 None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:42:53.566707 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:42:53.629577 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be6715b-14f3-4560-ab36-0cd7aaa82f03 None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:42:53.671750 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa51d251-699b-4a1b-82b8-09709b31a8be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:42:53.672391 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa51d251-699b-4a1b-82b8-09709b31a8be None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:42:53.672669 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa51d251-699b-4a1b-82b8-09709b31a8be None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:42:53.672946 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa51d251-699b-4a1b-82b8-09709b31a8be None admin] PATH_INFO: `/v3/projects` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:42:53.673736 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa51d251-699b-4a1b-82b8-09709b31a8be None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:42:53.674045 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa51d251-699b-4a1b-82b8-09709b31a8be None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:42:53.675575 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa51d251-699b-4a1b-82b8-09709b31a8be None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:42:53.690850 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 631/1286] 10.222.0.93 () {56 vars in 1148 bytes} [Tue Jul 26 14:42:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:42:53.697613 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60c9cd4-c523-434a-892d-381093bf5735 None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:42:53.845334 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60c9cd4-c523-434a-892d-381093bf5735 None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:42:53.898392 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b05240-3601-4012-a4f7-e4e37d312c32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:42:53.899184 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b05240-3601-4012-a4f7-e4e37d312c32 None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:42:53.899558 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b05240-3601-4012-a4f7-e4e37d312c32 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:42:53.899886 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b05240-3601-4012-a4f7-e4e37d312c32 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:42:53.900801 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b05240-3601-4012-a4f7-e4e37d312c32 None admin] RBAC: Adding query filter params (role.id=94e105ff8ee4486abd501415cc05ba38, scope.project.id=c422a2290a14424da20e2841cbc1741d, user.id=3e27fe21cc6048d5b9899b938d84ba5f) {{(pid=87056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:42:53.901153 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b05240-3601-4012-a4f7-e4e37d312c32 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:42:53.903150 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b05240-3601-4012-a4f7-e4e37d312c32 None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:42:53.910761 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 656/1287] 10.222.0.93 () {56 vars in 1374 bytes} [Tue Jul 26 14:42:53 2022] GET /identity/v3/role_assignments?user.id=3e27fe21cc6048d5b9899b938d84ba5f&scope.project.id=c422a2290a14424da20e2841cbc1741d&role.id=94e105ff8ee4486abd501415cc05ba38 => generated 608 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:42:56.079148 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c302d503-4472-4563-9300-0df21173ac73 None None] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:42:56.079659 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c302d503-4472-4563-9300-0df21173ac73 None None] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:42:56.079659 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c302d503-4472-4563-9300-0df21173ac73 None None] PATH_INFO: `/` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:42:56.081016 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 632/1288] 10.222.0.93 () {54 vars in 926 bytes} [Tue Jul 26 14:42:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 14:42:56.088258 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7988234c-8ad0-4fdd-b730-0e9c3a5e3bd8 None None] REQUEST_METHOD: `POST` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:42:56.089000 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7988234c-8ad0-4fdd-b730-0e9c3a5e3bd8 None None] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:42:56.089633 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7988234c-8ad0-4fdd-b730-0e9c3a5e3bd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:42:56.115110 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.auth.core [None req-7988234c-8ad0-4fdd-b730-0e9c3a5e3bd8 None None] MFA Rules not processed for user `e5ef88cc058f425b882bcb87a1e1e75c`. Rule list: `[]` (Enabled: `True`). {{(pid=87056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:42:56.117230 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.fernet_utils [None req-7988234c-8ad0-4fdd-b730-0e9c3a5e3bd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:42:56.154773 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:42:56.209204 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 657/1289] 10.222.0.93 () {58 vars in 1023 bytes} [Tue Jul 26 14:42:56 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 14:42:56.235737 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c302d503-4472-4563-9300-0df21173ac73 None None] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:42:56.365277 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c302d503-4472-4563-9300-0df21173ac73 None None] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:42:56.382229 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:42:56.409617 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269ef2b4-f3a5-4b3e-adcb-15e26ad75a19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:42:56.410309 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269ef2b4-f3a5-4b3e-adcb-15e26ad75a19 None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:42:56.410599 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269ef2b4-f3a5-4b3e-adcb-15e26ad75a19 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:42:56.410873 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269ef2b4-f3a5-4b3e-adcb-15e26ad75a19 None admin] PATH_INFO: `/v3/services/placement` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:42:56.411525 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269ef2b4-f3a5-4b3e-adcb-15e26ad75a19 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:42:56.412946 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269ef2b4-f3a5-4b3e-adcb-15e26ad75a19 None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:42:56.423434 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application [None req-269ef2b4-f3a5-4b3e-adcb-15e26ad75a19 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 26 14:42:56.423434 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:42:56.423434 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 14:42:56.423434 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 14:42:56.423434 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 14:42:56.423434 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 14:42:56.423434 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 14:42:56.423434 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 14:42:56.423434 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 26 14:42:56.423434 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Jul 26 14:42:56.423434 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 14:42:56.423434 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Jul 26 14:42:56.423434 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:42:56.423434 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:42:56.423434 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:42:56.423434 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:42:56.423434 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:42:56.424712 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:42:56.424712 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:42:56.424712 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:42:56.424712 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:42:56.424712 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:42:56.424712 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:42:56.424712 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 14:42:56.424712 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 14:42:56.424712 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 14:42:56.424712 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 14:42:56.424712 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:42:56.424712 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:42:56.424712 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:42:56.424712 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:42:56.424712 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:42:56.424712 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:42:56.426014 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:42:56.426014 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application with Lock( Jul 26 14:42:56.426014 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:42:56.426014 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:42:56.426014 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:42:56.426014 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:42:56.426014 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:42:56.426014 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:42:56.426014 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:42:56.426014 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:42:56.426014 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 14:42:56.426014 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 14:42:56.426014 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 26 14:42:56.426014 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Jul 26 14:42:56.426014 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 633/1290] 10.222.0.93 () {56 vars in 1117 bytes} [Tue Jul 26 14:42:56 2022] GET /identity/v3/services/placement => generated 90 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 14:42:56.431069 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7988234c-8ad0-4fdd-b730-0e9c3a5e3bd8 None None] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:42:56.547970 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7988234c-8ad0-4fdd-b730-0e9c3a5e3bd8 None None] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:42:56.588605 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7133b4-7c92-42cf-9ca0-1ed6a2a14c6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:42:56.589246 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7133b4-7c92-42cf-9ca0-1ed6a2a14c6d None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:42:56.590207 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7133b4-7c92-42cf-9ca0-1ed6a2a14c6d None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:42:56.590613 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7133b4-7c92-42cf-9ca0-1ed6a2a14c6d None admin] PATH_INFO: `/v3/services` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:42:56.591320 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7133b4-7c92-42cf-9ca0-1ed6a2a14c6d None admin] RBAC: Adding query filter params (name=placement) {{(pid=87056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:42:56.591636 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7133b4-7c92-42cf-9ca0-1ed6a2a14c6d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:42:56.593048 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7133b4-7c92-42cf-9ca0-1ed6a2a14c6d None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:42:56.598589 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 658/1291] 10.222.0.93 () {56 vars in 1116 bytes} [Tue Jul 26 14:42:56 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:42:56.604696 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269ef2b4-f3a5-4b3e-adcb-15e26ad75a19 None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:42:56.725584 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269ef2b4-f3a5-4b3e-adcb-15e26ad75a19 None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:42:56.767821 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd2da17-9a84-448c-affb-480f630bbebb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:42:56.768456 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd2da17-9a84-448c-affb-480f630bbebb None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:42:56.768733 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd2da17-9a84-448c-affb-480f630bbebb None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:42:56.769007 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd2da17-9a84-448c-affb-480f630bbebb None admin] PATH_INFO: `/v3/services` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:42:56.769681 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd2da17-9a84-448c-affb-480f630bbebb None admin] RBAC: Adding query filter params (type=placement) {{(pid=87055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:42:56.770023 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd2da17-9a84-448c-affb-480f630bbebb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:42:56.771451 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd2da17-9a84-448c-affb-480f630bbebb None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:42:56.776610 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 634/1292] 10.222.0.93 () {56 vars in 1116 bytes} [Tue Jul 26 14:42:56 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:42:59.000208 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a31793-91a3-4e4d-836a-daa3d3d7069e None None] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:42:59.000790 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a31793-91a3-4e4d-836a-daa3d3d7069e None None] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:42:59.000790 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a31793-91a3-4e4d-836a-daa3d3d7069e None None] PATH_INFO: `/` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:42:59.002224 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 659/1293] 10.222.0.93 () {54 vars in 926 bytes} [Tue Jul 26 14:42:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 14:42:59.008568 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b08adbd-0025-4c59-aad1-958f5a6ab7d7 None None] REQUEST_METHOD: `POST` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:42:59.009148 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b08adbd-0025-4c59-aad1-958f5a6ab7d7 None None] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:42:59.009148 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b08adbd-0025-4c59-aad1-958f5a6ab7d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:42:59.031826 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.auth.core [None req-7b08adbd-0025-4c59-aad1-958f5a6ab7d7 None None] MFA Rules not processed for user `e5ef88cc058f425b882bcb87a1e1e75c`. Rule list: `[]` (Enabled: `True`). {{(pid=87055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:42:59.033282 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.fernet_utils [None req-7b08adbd-0025-4c59-aad1-958f5a6ab7d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:42:59.069130 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:42:59.112819 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 635/1294] 10.222.0.93 () {58 vars in 1023 bytes} [Tue Jul 26 14:42:59 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 14:42:59.136439 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a31793-91a3-4e4d-836a-daa3d3d7069e None None] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:42:59.172185 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:42:59.248927 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a31793-91a3-4e4d-836a-daa3d3d7069e None None] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:42:59.288869 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54732a68-1eb2-4cc5-a591-fe7734bc3aee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:42:59.289382 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54732a68-1eb2-4cc5-a591-fe7734bc3aee None admin] REQUEST_METHOD: `POST` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:42:59.289663 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54732a68-1eb2-4cc5-a591-fe7734bc3aee None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:42:59.289936 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54732a68-1eb2-4cc5-a591-fe7734bc3aee None admin] PATH_INFO: `/v3/services` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:42:59.290830 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54732a68-1eb2-4cc5-a591-fe7734bc3aee None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:42:59.292229 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54732a68-1eb2-4cc5-a591-fe7734bc3aee None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:42:59.430176 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 660/1295] 10.222.0.93 () {60 vars in 1141 bytes} [Tue Jul 26 14:42:59 2022] POST /identity/v3/services => generated 246 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 14:43:01.753013 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a8ba39-afe3-46e6-8a68-4e10baad9e8b None None] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:43:01.753572 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a8ba39-afe3-46e6-8a68-4e10baad9e8b None None] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:43:01.753572 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a8ba39-afe3-46e6-8a68-4e10baad9e8b None None] PATH_INFO: `/` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:43:01.755017 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 636/1296] 10.222.0.93 () {54 vars in 926 bytes} [Tue Jul 26 14:43:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:43:01.761385 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61ba1f3-74dc-426f-9876-cdc88388627d None None] REQUEST_METHOD: `POST` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:43:01.761385 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61ba1f3-74dc-426f-9876-cdc88388627d None None] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:43:01.762765 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61ba1f3-74dc-426f-9876-cdc88388627d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:43:01.786994 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.auth.core [None req-d61ba1f3-74dc-426f-9876-cdc88388627d None None] MFA Rules not processed for user `e5ef88cc058f425b882bcb87a1e1e75c`. Rule list: `[]` (Enabled: `True`). {{(pid=87056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:43:01.789089 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.fernet_utils [None req-d61ba1f3-74dc-426f-9876-cdc88388627d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:43:01.880162 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 661/1297] 10.222.0.93 () {58 vars in 1023 bytes} [Tue Jul 26 14:43:01 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 14:43:01.904306 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a8ba39-afe3-46e6-8a68-4e10baad9e8b None None] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:43:02.016417 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a8ba39-afe3-46e6-8a68-4e10baad9e8b None None] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:43:02.055767 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93d08c3-e235-4331-9b98-4f7a91859f12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:43:02.056439 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93d08c3-e235-4331-9b98-4f7a91859f12 None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:43:02.056723 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93d08c3-e235-4331-9b98-4f7a91859f12 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:43:02.057000 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93d08c3-e235-4331-9b98-4f7a91859f12 None admin] PATH_INFO: `/v3/services/placement` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:43:02.057629 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93d08c3-e235-4331-9b98-4f7a91859f12 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:43:02.059693 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93d08c3-e235-4331-9b98-4f7a91859f12 None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:43:02.069240 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application [None req-d93d08c3-e235-4331-9b98-4f7a91859f12 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 26 14:43:02.069240 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:43:02.069240 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 14:43:02.069240 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 14:43:02.069240 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 14:43:02.069240 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 14:43:02.069240 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 14:43:02.069240 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 14:43:02.069240 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 26 14:43:02.069240 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Jul 26 14:43:02.069240 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 14:43:02.069240 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Jul 26 14:43:02.069240 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:43:02.069240 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:43:02.069240 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:43:02.069240 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:43:02.069240 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:43:02.070702 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:43:02.070702 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:43:02.070702 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:43:02.070702 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:43:02.070702 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:43:02.070702 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:43:02.070702 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 14:43:02.070702 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 14:43:02.070702 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 14:43:02.070702 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 14:43:02.070702 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:43:02.070702 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:43:02.070702 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:43:02.070702 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:43:02.070702 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:43:02.070702 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:43:02.071903 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:43:02.071903 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application with Lock( Jul 26 14:43:02.071903 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:43:02.071903 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:43:02.071903 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:43:02.071903 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:43:02.071903 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:43:02.071903 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:43:02.071903 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:43:02.071903 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:43:02.071903 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 14:43:02.071903 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 14:43:02.071903 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 26 14:43:02.071903 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Jul 26 14:43:02.071903 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 637/1298] 10.222.0.93 () {56 vars in 1117 bytes} [Tue Jul 26 14:43:01 2022] GET /identity/v3/services/placement => generated 90 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 14:43:02.077204 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61ba1f3-74dc-426f-9876-cdc88388627d None None] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:43:02.097475 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:43:02.192581 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61ba1f3-74dc-426f-9876-cdc88388627d None None] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:43:02.231573 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee19fd1-b7e5-4852-9171-f89582f6dcaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:43:02.232199 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee19fd1-b7e5-4852-9171-f89582f6dcaf None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:43:02.232477 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee19fd1-b7e5-4852-9171-f89582f6dcaf None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:43:02.232857 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee19fd1-b7e5-4852-9171-f89582f6dcaf None admin] PATH_INFO: `/v3/services` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:43:02.233544 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee19fd1-b7e5-4852-9171-f89582f6dcaf None admin] RBAC: Adding query filter params (name=placement) {{(pid=87056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:43:02.233846 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee19fd1-b7e5-4852-9171-f89582f6dcaf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:43:02.235254 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee19fd1-b7e5-4852-9171-f89582f6dcaf None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:43:02.240996 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 662/1299] 10.222.0.93 () {56 vars in 1116 bytes} [Tue Jul 26 14:43:02 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:43:02.251193 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93d08c3-e235-4331-9b98-4f7a91859f12 None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:43:02.285402 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:43:02.375681 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93d08c3-e235-4331-9b98-4f7a91859f12 None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:43:02.413798 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6ee8da-f5e2-462d-a51f-8b2690def422 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:43:02.414461 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6ee8da-f5e2-462d-a51f-8b2690def422 None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:43:02.414744 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6ee8da-f5e2-462d-a51f-8b2690def422 None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:43:02.415018 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6ee8da-f5e2-462d-a51f-8b2690def422 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:43:02.415869 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6ee8da-f5e2-462d-a51f-8b2690def422 None admin] RBAC: Adding query filter params (interface=public, service_id=48277943be5c47699353863473061b07, region_id=RegionOne) {{(pid=87055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:43:02.416189 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6ee8da-f5e2-462d-a51f-8b2690def422 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:43:02.417663 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6ee8da-f5e2-462d-a51f-8b2690def422 None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:43:02.425712 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 638/1300] 10.222.0.93 () {56 vars in 1251 bytes} [Tue Jul 26 14:43:02 2022] GET /identity/v3/endpoints?service_id=48277943be5c47699353863473061b07&interface=public®ion_id=RegionOne => generated 194 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:43:02.432159 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee19fd1-b7e5-4852-9171-f89582f6dcaf None admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:43:02.528869 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:43:02.551269 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee19fd1-b7e5-4852-9171-f89582f6dcaf None admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:43:02.591819 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5142fc-0a1e-4957-86be-c007675f6641 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:43:02.592555 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5142fc-0a1e-4957-86be-c007675f6641 None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:43:02.592883 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5142fc-0a1e-4957-86be-c007675f6641 None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:43:02.593203 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5142fc-0a1e-4957-86be-c007675f6641 None admin] PATH_INFO: `/v3/services` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:43:02.593918 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5142fc-0a1e-4957-86be-c007675f6641 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:43:02.595458 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5142fc-0a1e-4957-86be-c007675f6641 None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:43:02.603413 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 663/1301] 10.222.0.93 () {56 vars in 1087 bytes} [Tue Jul 26 14:43:02 2022] GET /identity/v3/services => generated 2191 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 14:43:04.791688 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96737ada-0e84-4a4b-965e-276c089e26b0 None None] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:43:04.793117 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96737ada-0e84-4a4b-965e-276c089e26b0 None None] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:43:04.793299 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96737ada-0e84-4a4b-965e-276c089e26b0 None None] PATH_INFO: `/` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:43:04.794830 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 639/1302] 10.222.0.93 () {54 vars in 926 bytes} [Tue Jul 26 14:43:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:43:04.801324 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dfe583-50c0-4e15-b494-9d3723629c5a None None] REQUEST_METHOD: `POST` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:43:04.801995 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dfe583-50c0-4e15-b494-9d3723629c5a None None] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:43:04.801995 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dfe583-50c0-4e15-b494-9d3723629c5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:43:04.822156 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.auth.core [None req-30dfe583-50c0-4e15-b494-9d3723629c5a None None] MFA Rules not processed for user `e5ef88cc058f425b882bcb87a1e1e75c`. Rule list: `[]` (Enabled: `True`). {{(pid=87056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:43:04.825662 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.fernet_utils [None req-30dfe583-50c0-4e15-b494-9d3723629c5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:43:04.900606 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 664/1303] 10.222.0.93 () {58 vars in 1023 bytes} [Tue Jul 26 14:43:04 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 26 14:43:04.925004 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96737ada-0e84-4a4b-965e-276c089e26b0 None None] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:43:05.038767 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:43:05.047209 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96737ada-0e84-4a4b-965e-276c089e26b0 None None] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:43:05.084566 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f1a97b-61fa-44df-b3fc-176b4347f0cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:43:05.085230 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f1a97b-61fa-44df-b3fc-176b4347f0cb None admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:43:05.085515 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f1a97b-61fa-44df-b3fc-176b4347f0cb None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:43:05.085792 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f1a97b-61fa-44df-b3fc-176b4347f0cb None admin] PATH_INFO: `/v3/services/placement` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:43:05.086461 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f1a97b-61fa-44df-b3fc-176b4347f0cb None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:43:05.087864 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f1a97b-61fa-44df-b3fc-176b4347f0cb None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:43:05.098181 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application [None req-f0f1a97b-61fa-44df-b3fc-176b4347f0cb None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 26 14:43:05.098181 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:43:05.098181 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 14:43:05.098181 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 14:43:05.098181 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 14:43:05.098181 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 14:43:05.098181 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 14:43:05.098181 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 14:43:05.098181 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 26 14:43:05.098181 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Jul 26 14:43:05.098181 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 14:43:05.098181 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Jul 26 14:43:05.098181 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 14:43:05.098181 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 14:43:05.098181 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 14:43:05.098181 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 14:43:05.098181 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 14:43:05.100383 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 14:43:05.100383 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 14:43:05.100383 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 14:43:05.100383 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 14:43:05.100383 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 14:43:05.100383 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 14:43:05.100383 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 14:43:05.100383 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 14:43:05.100383 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 14:43:05.100383 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 14:43:05.100383 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 14:43:05.100383 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 14:43:05.100383 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 14:43:05.100383 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 14:43:05.100383 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 14:43:05.100383 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 14:43:05.102212 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 14:43:05.102212 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application with Lock( Jul 26 14:43:05.102212 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 14:43:05.102212 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self._enter() Jul 26 14:43:05.102212 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 14:43:05.102212 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 14:43:05.102212 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 14:43:05.102212 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application return self.creator() Jul 26 14:43:05.102212 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 14:43:05.102212 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application created_value = creator( Jul 26 14:43:05.102212 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 14:43:05.102212 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 14:43:05.102212 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 26 14:43:05.102212 dv-cinder-851030-1-smb devstack@keystone.service[87055]: ERROR keystone.server.flask.application Jul 26 14:43:05.102212 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 640/1304] 10.222.0.93 () {56 vars in 1117 bytes} [Tue Jul 26 14:43:04 2022] GET /identity/v3/services/placement => generated 90 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 14:43:05.108076 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dfe583-50c0-4e15-b494-9d3723629c5a None None] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:43:05.199125 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:43:05.225364 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dfe583-50c0-4e15-b494-9d3723629c5a None None] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:43:05.266056 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8523068e-3884-4575-8451-9943051e7f9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:43:05.266740 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8523068e-3884-4575-8451-9943051e7f9c None admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:43:05.267025 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8523068e-3884-4575-8451-9943051e7f9c None admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:43:05.267304 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8523068e-3884-4575-8451-9943051e7f9c None admin] PATH_INFO: `/v3/services` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:43:05.268007 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8523068e-3884-4575-8451-9943051e7f9c None admin] RBAC: Adding query filter params (name=placement) {{(pid=87056) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:43:05.268332 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8523068e-3884-4575-8451-9943051e7f9c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:43:05.269818 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8523068e-3884-4575-8451-9943051e7f9c None admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:43:05.275851 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 665/1305] 10.222.0.93 () {56 vars in 1116 bytes} [Tue Jul 26 14:43:05 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 14:43:05.282822 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f1a97b-61fa-44df-b3fc-176b4347f0cb None admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:43:05.398162 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f1a97b-61fa-44df-b3fc-176b4347f0cb None admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:43:05.444504 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ace739-b4f9-4c08-b2b1-3e141e86daac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:43:05.445142 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ace739-b4f9-4c08-b2b1-3e141e86daac None admin] REQUEST_METHOD: `POST` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:43:05.445420 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ace739-b4f9-4c08-b2b1-3e141e86daac None admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:43:05.445696 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ace739-b4f9-4c08-b2b1-3e141e86daac None admin] PATH_INFO: `/v3/endpoints` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:43:05.446624 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ace739-b4f9-4c08-b2b1-3e141e86daac None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:43:05.449957 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ace739-b4f9-4c08-b2b1-3e141e86daac None admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:43:05.572603 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 641/1306] 10.222.0.93 () {60 vars in 1144 bytes} [Tue Jul 26 14:43:05 2022] POST /identity/v3/endpoints => generated 331 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 14:43:15.326487 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=30 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:43:15.567348 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:51:23.517403 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9d38ae-4650-459a-806d-b7f7fdc46918 None None] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:51:23.518032 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9d38ae-4650-459a-806d-b7f7fdc46918 None None] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:51:23.518742 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9d38ae-4650-459a-806d-b7f7fdc46918 None None] PATH_INFO: `/` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:51:23.532796 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5194a9c5-8b0a-4f2c-9cca-b0c89f945d40 None None] REQUEST_METHOD: `POST` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:51:23.533330 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5194a9c5-8b0a-4f2c-9cca-b0c89f945d40 None None] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:51:23.533794 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5194a9c5-8b0a-4f2c-9cca-b0c89f945d40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:51:23.539185 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 666/1307] 10.222.0.93 () {54 vars in 926 bytes} [Tue Jul 26 14:51:23 2022] GET /identity => generated 270 bytes in 24 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:51:23.792729 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.auth.core [None req-5194a9c5-8b0a-4f2c-9cca-b0c89f945d40 None None] MFA Rules not processed for user `e5ef88cc058f425b882bcb87a1e1e75c`. Rule list: `[]` (Enabled: `True`). {{(pid=87055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:51:23.794745 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.fernet_utils [None req-5194a9c5-8b0a-4f2c-9cca-b0c89f945d40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:51:23.986271 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 642/1308] 10.222.0.93 () {58 vars in 1023 bytes} [Tue Jul 26 14:51:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 445 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 14:51:24.072388 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a75d8ea-4886-455e-81d4-fc1eece51d19 None None] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:51:24.073531 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a75d8ea-4886-455e-81d4-fc1eece51d19 None None] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:51:24.074332 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a75d8ea-4886-455e-81d4-fc1eece51d19 None None] PATH_INFO: `/` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:51:24.077343 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 667/1309] 10.222.0.93 () {54 vars in 965 bytes} [Tue Jul 26 14:51:24 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:51:24.087729 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ade7da0-ab31-483b-abfa-56e53c987921 None None] REQUEST_METHOD: `POST` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:51:24.088793 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ade7da0-ab31-483b-abfa-56e53c987921 None None] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:51:24.089569 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ade7da0-ab31-483b-abfa-56e53c987921 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:51:24.198186 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.auth.core [None req-1ade7da0-ab31-483b-abfa-56e53c987921 None None] MFA Rules not processed for user `541dcf2b85a145e99c7d0663a0ac0918`. Rule list: `[]` (Enabled: `True`). {{(pid=87055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:51:24.199525 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.fernet_utils [None req-1ade7da0-ab31-483b-abfa-56e53c987921 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:51:24.227804 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:51:24.299713 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 643/1310] 10.222.0.93 () {58 vars in 1062 bytes} [Tue Jul 26 14:51:24 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 14:51:24.314822 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a75d8ea-4886-455e-81d4-fc1eece51d19 None None] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:51:24.319295 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.fernet_utils [None req-7a75d8ea-4886-455e-81d4-fc1eece51d19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:51:24.569868 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a75d8ea-4886-455e-81d4-fc1eece51d19 None None] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:51:24.786309 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2330232-ff64-40a7-82d5-7878dd4efea0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '541dcf2b85a145e99c7d0663a0ac0918', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c422a2290a14424da20e2841cbc1741d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:51:24.788483 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2330232-ff64-40a7-82d5-7878dd4efea0 service neutron] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:51:24.789312 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2330232-ff64-40a7-82d5-7878dd4efea0 service neutron] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:51:24.790068 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2330232-ff64-40a7-82d5-7878dd4efea0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:51:24.793931 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.fernet_utils [None req-a2330232-ff64-40a7-82d5-7878dd4efea0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:51:24.930259 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:51:25.064820 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2330232-ff64-40a7-82d5-7878dd4efea0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:51:25.067980 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2330232-ff64-40a7-82d5-7878dd4efea0 service neutron] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:51:25.115019 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 668/1311] 10.222.0.93 () {60 vars in 1365 bytes} [Tue Jul 26 14:51:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 801 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 14:51:27.909822 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c9cb26-c5f4-406e-9338-98c45b3842eb None None] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:51:27.910694 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c9cb26-c5f4-406e-9338-98c45b3842eb None None] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:51:27.910694 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c9cb26-c5f4-406e-9338-98c45b3842eb None None] PATH_INFO: `/` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:51:27.911864 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 644/1312] 10.222.0.93 () {54 vars in 926 bytes} [Tue Jul 26 14:51:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 14:51:27.921824 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b40df5-288a-475a-b10c-c0a915d0eab1 None None] REQUEST_METHOD: `POST` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:51:27.922452 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b40df5-288a-475a-b10c-c0a915d0eab1 None None] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:51:27.922846 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b40df5-288a-475a-b10c-c0a915d0eab1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:51:28.041577 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.auth.core [None req-04b40df5-288a-475a-b10c-c0a915d0eab1 None None] MFA Rules not processed for user `e5ef88cc058f425b882bcb87a1e1e75c`. Rule list: `[]` (Enabled: `True`). {{(pid=87056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:51:28.042868 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.fernet_utils [None req-04b40df5-288a-475a-b10c-c0a915d0eab1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:51:28.182324 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 669/1313] 10.222.0.93 () {58 vars in 1023 bytes} [Tue Jul 26 14:51:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 14:51:28.261923 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83acb61c-552a-457b-8a4c-98e13a3f9c1b None None] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:51:28.262318 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83acb61c-552a-457b-8a4c-98e13a3f9c1b None None] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:51:28.262648 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83acb61c-552a-457b-8a4c-98e13a3f9c1b None None] PATH_INFO: `/` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:51:28.264901 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 645/1314] 10.222.0.93 () {54 vars in 965 bytes} [Tue Jul 26 14:51:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:51:28.273904 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565e4e91-1f4c-4a2f-8099-8c3de6a1ad22 None None] REQUEST_METHOD: `POST` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:51:28.274474 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565e4e91-1f4c-4a2f-8099-8c3de6a1ad22 None None] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:51:28.275159 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565e4e91-1f4c-4a2f-8099-8c3de6a1ad22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:51:28.291949 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:51:28.390223 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.auth.core [None req-565e4e91-1f4c-4a2f-8099-8c3de6a1ad22 None None] MFA Rules not processed for user `541dcf2b85a145e99c7d0663a0ac0918`. Rule list: `[]` (Enabled: `True`). {{(pid=87056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:51:28.391612 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.fernet_utils [None req-565e4e91-1f4c-4a2f-8099-8c3de6a1ad22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:51:28.506910 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 670/1315] 10.222.0.93 () {58 vars in 1062 bytes} [Tue Jul 26 14:51:28 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 14:51:28.516787 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83acb61c-552a-457b-8a4c-98e13a3f9c1b None None] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:51:28.519129 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.fernet_utils [None req-83acb61c-552a-457b-8a4c-98e13a3f9c1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:51:28.677362 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83acb61c-552a-457b-8a4c-98e13a3f9c1b None None] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:51:28.763511 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:51:28.765991 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cedc249-eaf4-48a9-81e3-5ace8889b627 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '541dcf2b85a145e99c7d0663a0ac0918', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c422a2290a14424da20e2841cbc1741d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:51:28.766658 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cedc249-eaf4-48a9-81e3-5ace8889b627 service neutron] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:51:28.766942 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cedc249-eaf4-48a9-81e3-5ace8889b627 service neutron] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:51:28.767221 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cedc249-eaf4-48a9-81e3-5ace8889b627 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:51:28.768985 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.fernet_utils [None req-5cedc249-eaf4-48a9-81e3-5ace8889b627 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:51:28.905636 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cedc249-eaf4-48a9-81e3-5ace8889b627 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:51:28.908399 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cedc249-eaf4-48a9-81e3-5ace8889b627 service neutron] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:51:28.934496 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 646/1316] 10.222.0.93 () {60 vars in 1365 bytes} [Tue Jul 26 14:51:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 14:51:32.593347 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88283bd5-74c3-49f0-ade4-0190f45418d0 None None] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:51:32.594117 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88283bd5-74c3-49f0-ade4-0190f45418d0 None None] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:51:32.594117 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88283bd5-74c3-49f0-ade4-0190f45418d0 None None] PATH_INFO: `/` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:51:32.595354 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 671/1317] 10.222.0.93 () {54 vars in 926 bytes} [Tue Jul 26 14:51:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 14:51:32.601661 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba15304f-ce85-433b-b5b5-5defbf5afd33 None None] REQUEST_METHOD: `POST` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:51:32.602588 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba15304f-ce85-433b-b5b5-5defbf5afd33 None None] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:51:32.605914 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba15304f-ce85-433b-b5b5-5defbf5afd33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:51:32.690589 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.auth.core [None req-ba15304f-ce85-433b-b5b5-5defbf5afd33 None None] MFA Rules not processed for user `7295436e2b73480da2d21e361333fbb8`. Rule list: `[]` (Enabled: `True`). {{(pid=87055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:51:32.692101 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.fernet_utils [None req-ba15304f-ce85-433b-b5b5-5defbf5afd33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:51:32.759982 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:51:32.814104 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 647/1318] 10.222.0.93 () {58 vars in 1023 bytes} [Tue Jul 26 14:51:32 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 14:51:32.855396 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88283bd5-74c3-49f0-ade4-0190f45418d0 None None] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:51:32.856950 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.fernet_utils [None req-88283bd5-74c3-49f0-ade4-0190f45418d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:51:32.981330 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88283bd5-74c3-49f0-ade4-0190f45418d0 None None] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:51:32.984618 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:51:33.068173 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bc8ac7-f0fe-4025-aa6f-5d5a1d66a5bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '541dcf2b85a145e99c7d0663a0ac0918', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c422a2290a14424da20e2841cbc1741d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:51:33.069405 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bc8ac7-f0fe-4025-aa6f-5d5a1d66a5bf service neutron] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:51:33.069678 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bc8ac7-f0fe-4025-aa6f-5d5a1d66a5bf service neutron] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:51:33.070618 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bc8ac7-f0fe-4025-aa6f-5d5a1d66a5bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:51:33.073628 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.fernet_utils [None req-79bc8ac7-f0fe-4025-aa6f-5d5a1d66a5bf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:51:33.213069 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bc8ac7-f0fe-4025-aa6f-5d5a1d66a5bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:51:33.214572 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bc8ac7-f0fe-4025-aa6f-5d5a1d66a5bf service neutron] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:51:33.236563 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 672/1319] 10.222.0.93 () {60 vars in 1365 bytes} [Tue Jul 26 14:51:32 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 14:51:36.469720 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41905cef-1397-42db-aa11-6e376931e7e5 None None] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:51:36.470434 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41905cef-1397-42db-aa11-6e376931e7e5 None None] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:51:36.470685 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41905cef-1397-42db-aa11-6e376931e7e5 None None] PATH_INFO: `/` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:51:36.473186 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 648/1320] 10.222.0.93 () {54 vars in 926 bytes} [Tue Jul 26 14:51:36 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:51:36.480928 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7901a1b7-37fd-4f44-83ac-5d742c00eda4 None None] REQUEST_METHOD: `POST` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:51:36.481480 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7901a1b7-37fd-4f44-83ac-5d742c00eda4 None None] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:51:36.481856 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7901a1b7-37fd-4f44-83ac-5d742c00eda4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:51:36.559689 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:51:36.604552 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.auth.core [None req-7901a1b7-37fd-4f44-83ac-5d742c00eda4 None None] MFA Rules not processed for user `e5ef88cc058f425b882bcb87a1e1e75c`. Rule list: `[]` (Enabled: `True`). {{(pid=87056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:51:36.606713 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.fernet_utils [None req-7901a1b7-37fd-4f44-83ac-5d742c00eda4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:51:36.747345 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 673/1321] 10.222.0.93 () {58 vars in 1023 bytes} [Tue Jul 26 14:51:36 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 14:51:36.792498 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41905cef-1397-42db-aa11-6e376931e7e5 None None] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:51:36.794152 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.fernet_utils [None req-41905cef-1397-42db-aa11-6e376931e7e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:51:36.918586 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41905cef-1397-42db-aa11-6e376931e7e5 None None] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:51:37.005203 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01074b58-75f0-4789-aa45-7a542cfb457d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '541dcf2b85a145e99c7d0663a0ac0918', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c422a2290a14424da20e2841cbc1741d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:51:37.005902 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01074b58-75f0-4789-aa45-7a542cfb457d service neutron] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:51:37.006212 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01074b58-75f0-4789-aa45-7a542cfb457d service neutron] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:51:37.006543 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01074b58-75f0-4789-aa45-7a542cfb457d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:51:37.008498 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.fernet_utils [None req-01074b58-75f0-4789-aa45-7a542cfb457d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:51:37.016579 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:51:37.129463 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01074b58-75f0-4789-aa45-7a542cfb457d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:51:37.131484 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01074b58-75f0-4789-aa45-7a542cfb457d service neutron] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:51:37.152946 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 649/1322] 10.222.0.93 () {60 vars in 1365 bytes} [Tue Jul 26 14:51:36 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 14:51:41.197039 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb08da02-1edc-403c-a643-f32e033277ea None None] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:51:41.197589 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb08da02-1edc-403c-a643-f32e033277ea None None] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:51:41.198130 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb08da02-1edc-403c-a643-f32e033277ea None None] PATH_INFO: `/` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:51:41.200731 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 674/1323] 10.222.0.93 () {54 vars in 926 bytes} [Tue Jul 26 14:51:41 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:51:41.209990 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84048c19-3430-4287-a2b1-a985175f53ec None None] REQUEST_METHOD: `POST` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:51:41.210577 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84048c19-3430-4287-a2b1-a985175f53ec None None] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:51:41.211025 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84048c19-3430-4287-a2b1-a985175f53ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:51:41.335160 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.auth.core [None req-84048c19-3430-4287-a2b1-a985175f53ec None None] MFA Rules not processed for user `e5ef88cc058f425b882bcb87a1e1e75c`. Rule list: `[]` (Enabled: `True`). {{(pid=87055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:51:41.337277 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.fernet_utils [None req-84048c19-3430-4287-a2b1-a985175f53ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:51:41.453992 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:51:41.536585 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 650/1324] 10.222.0.93 () {58 vars in 1023 bytes} [Tue Jul 26 14:51:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 328 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 14:51:41.600478 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb08da02-1edc-403c-a643-f32e033277ea None None] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:51:41.602663 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.fernet_utils [None req-cb08da02-1edc-403c-a643-f32e033277ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:51:41.809906 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb08da02-1edc-403c-a643-f32e033277ea None None] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:51:41.834642 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:51:41.914690 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077c7df3-91a5-4cc4-ac26-cd209833cfcb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '541dcf2b85a145e99c7d0663a0ac0918', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c422a2290a14424da20e2841cbc1741d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:51:41.915411 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077c7df3-91a5-4cc4-ac26-cd209833cfcb service neutron] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:51:41.915779 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077c7df3-91a5-4cc4-ac26-cd209833cfcb service neutron] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:51:41.916158 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077c7df3-91a5-4cc4-ac26-cd209833cfcb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:51:41.918053 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.fernet_utils [None req-077c7df3-91a5-4cc4-ac26-cd209833cfcb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:51:42.094216 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077c7df3-91a5-4cc4-ac26-cd209833cfcb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:51:42.096967 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077c7df3-91a5-4cc4-ac26-cd209833cfcb service neutron] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:51:42.141745 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 675/1325] 10.222.0.93 () {60 vars in 1365 bytes} [Tue Jul 26 14:51:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 543 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 14:51:44.679022 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32df0fd0-e1d0-48f8-b16d-3fc6f0f8c69e None None] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:51:44.679817 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32df0fd0-e1d0-48f8-b16d-3fc6f0f8c69e None None] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:51:44.679817 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32df0fd0-e1d0-48f8-b16d-3fc6f0f8c69e None None] PATH_INFO: `/` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:51:44.680995 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 651/1326] 10.222.0.93 () {54 vars in 926 bytes} [Tue Jul 26 14:51:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:51:44.689330 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08aa5e00-272b-48e4-bc54-206eaa32213b None None] REQUEST_METHOD: `POST` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:51:44.690162 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08aa5e00-272b-48e4-bc54-206eaa32213b None None] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:51:44.690162 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08aa5e00-272b-48e4-bc54-206eaa32213b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:51:44.787364 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:51:44.821301 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.auth.core [None req-08aa5e00-272b-48e4-bc54-206eaa32213b None None] MFA Rules not processed for user `e5ef88cc058f425b882bcb87a1e1e75c`. Rule list: `[]` (Enabled: `True`). {{(pid=87056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:51:44.822770 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.fernet_utils [None req-08aa5e00-272b-48e4-bc54-206eaa32213b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:51:45.099368 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 676/1327] 10.222.0.93 () {58 vars in 1023 bytes} [Tue Jul 26 14:51:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 14:51:45.101023 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32df0fd0-e1d0-48f8-b16d-3fc6f0f8c69e None None] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:51:45.101023 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.fernet_utils [None req-32df0fd0-e1d0-48f8-b16d-3fc6f0f8c69e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:51:45.187825 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32df0fd0-e1d0-48f8-b16d-3fc6f0f8c69e None None] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:51:45.293060 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81406371-ab35-4bef-b635-b9013624752f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '541dcf2b85a145e99c7d0663a0ac0918', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c422a2290a14424da20e2841cbc1741d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:51:45.293842 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81406371-ab35-4bef-b635-b9013624752f service neutron] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:51:45.294120 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81406371-ab35-4bef-b635-b9013624752f service neutron] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:51:45.294431 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81406371-ab35-4bef-b635-b9013624752f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:51:45.296096 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.fernet_utils [None req-81406371-ab35-4bef-b635-b9013624752f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:51:45.322667 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:51:45.441113 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81406371-ab35-4bef-b635-b9013624752f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:51:45.442674 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81406371-ab35-4bef-b635-b9013624752f service neutron] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:51:45.466541 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 652/1328] 10.222.0.93 () {60 vars in 1365 bytes} [Tue Jul 26 14:51:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 14:51:47.923879 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7764ac8b-c616-4544-b216-66b9985a1724 None None] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:51:47.924741 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7764ac8b-c616-4544-b216-66b9985a1724 None None] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:51:47.924925 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7764ac8b-c616-4544-b216-66b9985a1724 None None] PATH_INFO: `/` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:51:47.926764 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 677/1329] 10.222.0.93 () {54 vars in 926 bytes} [Tue Jul 26 14:51:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 14:51:47.934717 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84aa089-0f8a-4728-8c5d-592bac580881 None None] REQUEST_METHOD: `POST` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:51:47.935924 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84aa089-0f8a-4728-8c5d-592bac580881 None None] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:51:47.935924 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84aa089-0f8a-4728-8c5d-592bac580881 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:51:48.017012 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.auth.core [None req-e84aa089-0f8a-4728-8c5d-592bac580881 None None] MFA Rules not processed for user `7295436e2b73480da2d21e361333fbb8`. Rule list: `[]` (Enabled: `True`). {{(pid=87055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:51:48.018268 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.fernet_utils [None req-e84aa089-0f8a-4728-8c5d-592bac580881 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:51:48.101243 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:51:48.142989 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 653/1330] 10.222.0.93 () {58 vars in 1023 bytes} [Tue Jul 26 14:51:47 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 14:51:48.189140 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7764ac8b-c616-4544-b216-66b9985a1724 None None] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:51:48.190822 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.fernet_utils [None req-7764ac8b-c616-4544-b216-66b9985a1724 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:51:48.377977 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7764ac8b-c616-4544-b216-66b9985a1724 None None] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:51:48.409450 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:51:48.642518 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc101cc6-c992-44fd-8c9a-89d22124135a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '541dcf2b85a145e99c7d0663a0ac0918', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c422a2290a14424da20e2841cbc1741d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:51:48.643685 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc101cc6-c992-44fd-8c9a-89d22124135a service neutron] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:51:48.644152 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc101cc6-c992-44fd-8c9a-89d22124135a service neutron] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:51:48.644619 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc101cc6-c992-44fd-8c9a-89d22124135a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:51:48.648829 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.fernet_utils [None req-cc101cc6-c992-44fd-8c9a-89d22124135a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:51:48.845137 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc101cc6-c992-44fd-8c9a-89d22124135a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:51:48.845137 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc101cc6-c992-44fd-8c9a-89d22124135a service neutron] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:51:48.876734 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 678/1331] 10.222.0.93 () {60 vars in 1365 bytes} [Tue Jul 26 14:51:48 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 688 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 14:51:52.113585 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7724488-3982-40c0-97f6-a4ab0758865a None None] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:51:52.114376 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7724488-3982-40c0-97f6-a4ab0758865a None None] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:51:52.114376 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7724488-3982-40c0-97f6-a4ab0758865a None None] PATH_INFO: `/` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:51:52.116633 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 654/1332] 10.222.0.93 () {54 vars in 926 bytes} [Tue Jul 26 14:51:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:51:52.126078 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a75e63-6737-403a-b9b7-33d4134bf010 None None] REQUEST_METHOD: `POST` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:51:52.126732 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a75e63-6737-403a-b9b7-33d4134bf010 None None] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:51:52.127049 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a75e63-6737-403a-b9b7-33d4134bf010 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:51:52.224853 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:51:52.228500 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.auth.core [None req-b0a75e63-6737-403a-b9b7-33d4134bf010 None None] MFA Rules not processed for user `e5ef88cc058f425b882bcb87a1e1e75c`. Rule list: `[]` (Enabled: `True`). {{(pid=87056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:51:52.229794 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.fernet_utils [None req-b0a75e63-6737-403a-b9b7-33d4134bf010 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:51:52.347519 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 679/1333] 10.222.0.93 () {58 vars in 1023 bytes} [Tue Jul 26 14:51:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 14:51:52.387471 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7724488-3982-40c0-97f6-a4ab0758865a None None] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:51:52.389145 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.fernet_utils [None req-c7724488-3982-40c0-97f6-a4ab0758865a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:51:52.518785 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7724488-3982-40c0-97f6-a4ab0758865a None None] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:51:52.611553 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a006f0-3af6-4641-9002-57dc2bcc3be7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '541dcf2b85a145e99c7d0663a0ac0918', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c422a2290a14424da20e2841cbc1741d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:51:52.612180 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a006f0-3af6-4641-9002-57dc2bcc3be7 service neutron] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:51:52.612457 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a006f0-3af6-4641-9002-57dc2bcc3be7 service neutron] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:51:52.612730 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a006f0-3af6-4641-9002-57dc2bcc3be7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:51:52.615285 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.fernet_utils [None req-f4a006f0-3af6-4641-9002-57dc2bcc3be7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:51:52.663463 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:51:52.812120 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a006f0-3af6-4641-9002-57dc2bcc3be7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:51:52.813897 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a006f0-3af6-4641-9002-57dc2bcc3be7 service neutron] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:51:52.838517 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 655/1334] 10.222.0.93 () {60 vars in 1365 bytes} [Tue Jul 26 14:51:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 451 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 14:51:55.076812 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f93d528-cb14-41ed-adca-cd4c3ebc4d86 None None] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:51:55.077357 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f93d528-cb14-41ed-adca-cd4c3ebc4d86 None None] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:51:55.077699 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f93d528-cb14-41ed-adca-cd4c3ebc4d86 None None] PATH_INFO: `/` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:51:55.080280 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 680/1335] 10.222.0.93 () {54 vars in 926 bytes} [Tue Jul 26 14:51:55 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:51:55.087848 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3b53fb-8a62-4547-9a63-712573d2fca6 None None] REQUEST_METHOD: `POST` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:51:55.088423 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3b53fb-8a62-4547-9a63-712573d2fca6 None None] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:51:55.088569 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3b53fb-8a62-4547-9a63-712573d2fca6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:51:55.189056 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.auth.core [None req-cf3b53fb-8a62-4547-9a63-712573d2fca6 None None] MFA Rules not processed for user `e5ef88cc058f425b882bcb87a1e1e75c`. Rule list: `[]` (Enabled: `True`). {{(pid=87055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:51:55.190852 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.fernet_utils [None req-cf3b53fb-8a62-4547-9a63-712573d2fca6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:51:55.291939 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:51:55.320828 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 656/1336] 10.222.0.93 () {58 vars in 1023 bytes} [Tue Jul 26 14:51:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 14:51:55.364521 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f93d528-cb14-41ed-adca-cd4c3ebc4d86 None None] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:51:55.366785 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.fernet_utils [None req-0f93d528-cb14-41ed-adca-cd4c3ebc4d86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:51:55.503784 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f93d528-cb14-41ed-adca-cd4c3ebc4d86 None None] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:51:55.543590 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:51:55.610408 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f1c38f-6ead-461a-80eb-a7621bb12d5c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '541dcf2b85a145e99c7d0663a0ac0918', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c422a2290a14424da20e2841cbc1741d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:51:55.611218 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f1c38f-6ead-461a-80eb-a7621bb12d5c service neutron] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:51:55.611624 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f1c38f-6ead-461a-80eb-a7621bb12d5c service neutron] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:51:55.612021 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f1c38f-6ead-461a-80eb-a7621bb12d5c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:51:55.615417 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.fernet_utils [None req-57f1c38f-6ead-461a-80eb-a7621bb12d5c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:51:55.783815 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f1c38f-6ead-461a-80eb-a7621bb12d5c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:51:55.785384 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f1c38f-6ead-461a-80eb-a7621bb12d5c service neutron] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:51:55.812285 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 681/1337] 10.222.0.93 () {60 vars in 1365 bytes} [Tue Jul 26 14:51:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 448 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 14:51:59.076061 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ac3ba3-4349-491f-9aa5-6134f9f7ef60 None None] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:51:59.076636 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ac3ba3-4349-491f-9aa5-6134f9f7ef60 None None] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:51:59.076636 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ac3ba3-4349-491f-9aa5-6134f9f7ef60 None None] PATH_INFO: `/` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:51:59.078145 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 657/1338] 10.222.0.93 () {54 vars in 926 bytes} [Tue Jul 26 14:51:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:51:59.084386 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e978a325-97be-4f7b-a005-15470baa66ba None None] REQUEST_METHOD: `POST` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:51:59.084967 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e978a325-97be-4f7b-a005-15470baa66ba None None] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:51:59.084967 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e978a325-97be-4f7b-a005-15470baa66ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:51:59.176322 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.auth.core [None req-e978a325-97be-4f7b-a005-15470baa66ba None None] MFA Rules not processed for user `e5ef88cc058f425b882bcb87a1e1e75c`. Rule list: `[]` (Enabled: `True`). {{(pid=87056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:51:59.179571 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.fernet_utils [None req-e978a325-97be-4f7b-a005-15470baa66ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:51:59.194587 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:51:59.320291 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 682/1339] 10.222.0.93 () {58 vars in 1023 bytes} [Tue Jul 26 14:51:59 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 14:51:59.361764 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ac3ba3-4349-491f-9aa5-6134f9f7ef60 None None] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:51:59.363428 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.fernet_utils [None req-13ac3ba3-4349-491f-9aa5-6134f9f7ef60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:51:59.510537 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ac3ba3-4349-491f-9aa5-6134f9f7ef60 None None] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:51:59.612541 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90136717-3426-4fdc-8dcb-260dd7c77c78 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '541dcf2b85a145e99c7d0663a0ac0918', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c422a2290a14424da20e2841cbc1741d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:51:59.613174 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90136717-3426-4fdc-8dcb-260dd7c77c78 service neutron] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:51:59.613458 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90136717-3426-4fdc-8dcb-260dd7c77c78 service neutron] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:51:59.613733 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90136717-3426-4fdc-8dcb-260dd7c77c78 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:51:59.615592 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.fernet_utils [None req-90136717-3426-4fdc-8dcb-260dd7c77c78 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:51:59.664235 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:51:59.761822 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90136717-3426-4fdc-8dcb-260dd7c77c78 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:51:59.763431 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90136717-3426-4fdc-8dcb-260dd7c77c78 service neutron] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:51:59.788300 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 658/1340] 10.222.0.93 () {60 vars in 1365 bytes} [Tue Jul 26 14:51:59 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 14:52:04.884683 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79e6d51-0c20-4b9e-ba68-7f6b5472cd32 None None] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:52:04.884683 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79e6d51-0c20-4b9e-ba68-7f6b5472cd32 None None] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:52:04.884683 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79e6d51-0c20-4b9e-ba68-7f6b5472cd32 None None] PATH_INFO: `/` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:52:04.887320 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 683/1341] 10.222.0.93 () {54 vars in 926 bytes} [Tue Jul 26 14:52:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:52:04.891645 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f2987b-c68e-4a54-a7a2-8ba1224d3f21 None None] REQUEST_METHOD: `POST` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:52:04.892401 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f2987b-c68e-4a54-a7a2-8ba1224d3f21 None None] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:52:04.892401 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f2987b-c68e-4a54-a7a2-8ba1224d3f21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:52:05.018551 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.auth.core [None req-d3f2987b-c68e-4a54-a7a2-8ba1224d3f21 None None] MFA Rules not processed for user `e5ef88cc058f425b882bcb87a1e1e75c`. Rule list: `[]` (Enabled: `True`). {{(pid=87055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:52:05.021404 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.fernet_utils [None req-d3f2987b-c68e-4a54-a7a2-8ba1224d3f21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:52:05.162523 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:52:05.177333 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 659/1342] 10.222.0.93 () {58 vars in 1023 bytes} [Tue Jul 26 14:52:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 14:52:05.221915 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79e6d51-0c20-4b9e-ba68-7f6b5472cd32 None None] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:52:05.225003 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.fernet_utils [None req-b79e6d51-0c20-4b9e-ba68-7f6b5472cd32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:52:05.428422 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79e6d51-0c20-4b9e-ba68-7f6b5472cd32 None None] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:52:05.486424 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:52:05.563390 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8b2004-522e-46a5-aff6-e065611778d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '541dcf2b85a145e99c7d0663a0ac0918', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c422a2290a14424da20e2841cbc1741d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:52:05.564095 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8b2004-522e-46a5-aff6-e065611778d5 service neutron] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:52:05.564382 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8b2004-522e-46a5-aff6-e065611778d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:52:05.564652 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8b2004-522e-46a5-aff6-e065611778d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:52:05.566830 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.fernet_utils [None req-9a8b2004-522e-46a5-aff6-e065611778d5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:52:05.753740 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8b2004-522e-46a5-aff6-e065611778d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:52:05.756879 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8b2004-522e-46a5-aff6-e065611778d5 service neutron] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:52:05.782771 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 684/1343] 10.222.0.93 () {60 vars in 1365 bytes} [Tue Jul 26 14:52:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 562 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 14:52:09.808219 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93bfd37-2e40-4fde-8b7c-7f444e03fcd4 None None] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:52:09.808791 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93bfd37-2e40-4fde-8b7c-7f444e03fcd4 None None] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:52:09.808791 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93bfd37-2e40-4fde-8b7c-7f444e03fcd4 None None] PATH_INFO: `/` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:52:09.810454 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 660/1344] 10.222.0.93 () {54 vars in 926 bytes} [Tue Jul 26 14:52:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:52:09.819882 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f10a074-5702-4330-a73b-10ec8ae783fb None None] REQUEST_METHOD: `POST` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:52:09.820478 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f10a074-5702-4330-a73b-10ec8ae783fb None None] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:52:09.820936 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f10a074-5702-4330-a73b-10ec8ae783fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:52:09.918205 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.auth.core [None req-8f10a074-5702-4330-a73b-10ec8ae783fb None None] MFA Rules not processed for user `e5ef88cc058f425b882bcb87a1e1e75c`. Rule list: `[]` (Enabled: `True`). {{(pid=87056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:52:09.919559 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.fernet_utils [None req-8f10a074-5702-4330-a73b-10ec8ae783fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:52:09.943021 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:52:10.041422 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 685/1345] 10.222.0.93 () {58 vars in 1023 bytes} [Tue Jul 26 14:52:09 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 14:52:10.080389 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93bfd37-2e40-4fde-8b7c-7f444e03fcd4 None None] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:52:10.084949 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.fernet_utils [None req-a93bfd37-2e40-4fde-8b7c-7f444e03fcd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:52:10.258554 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93bfd37-2e40-4fde-8b7c-7f444e03fcd4 None None] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:52:10.358629 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3c9e47-5dd9-4115-9581-4a852617a9ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '541dcf2b85a145e99c7d0663a0ac0918', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c422a2290a14424da20e2841cbc1741d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:52:10.359285 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3c9e47-5dd9-4115-9581-4a852617a9ca service neutron] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:52:10.359647 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3c9e47-5dd9-4115-9581-4a852617a9ca service neutron] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:52:10.359930 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3c9e47-5dd9-4115-9581-4a852617a9ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:52:10.361959 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.fernet_utils [None req-df3c9e47-5dd9-4115-9581-4a852617a9ca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:52:10.428207 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:52:10.532676 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3c9e47-5dd9-4115-9581-4a852617a9ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:52:10.535076 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3c9e47-5dd9-4115-9581-4a852617a9ca service neutron] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:52:10.561726 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 661/1346] 10.222.0.93 () {60 vars in 1365 bytes} [Tue Jul 26 14:52:10 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 482 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 14:52:16.616142 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f6f93e-f14d-4595-91e8-5c4e48dcf254 None None] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:52:16.616899 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f6f93e-f14d-4595-91e8-5c4e48dcf254 None None] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:52:16.617183 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f6f93e-f14d-4595-91e8-5c4e48dcf254 None None] PATH_INFO: `/` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:52:16.620251 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 686/1347] 10.222.0.93 () {54 vars in 926 bytes} [Tue Jul 26 14:52:16 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:52:16.627382 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0fee01-ca0d-4aee-8fd0-0a490b5db1f6 None None] REQUEST_METHOD: `POST` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:52:16.628086 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0fee01-ca0d-4aee-8fd0-0a490b5db1f6 None None] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:52:16.628353 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0fee01-ca0d-4aee-8fd0-0a490b5db1f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:52:16.765724 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.auth.core [None req-2c0fee01-ca0d-4aee-8fd0-0a490b5db1f6 None None] MFA Rules not processed for user `e5ef88cc058f425b882bcb87a1e1e75c`. Rule list: `[]` (Enabled: `True`). {{(pid=87055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:52:16.767375 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.fernet_utils [None req-2c0fee01-ca0d-4aee-8fd0-0a490b5db1f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:52:16.973771 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:52:16.977717 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 662/1348] 10.222.0.93 () {58 vars in 1023 bytes} [Tue Jul 26 14:52:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 352 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 14:52:17.050444 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f6f93e-f14d-4595-91e8-5c4e48dcf254 None None] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:52:17.053128 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.fernet_utils [None req-95f6f93e-f14d-4595-91e8-5c4e48dcf254 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:52:17.247195 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f6f93e-f14d-4595-91e8-5c4e48dcf254 None None] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:52:17.344089 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:52:17.392904 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09187a1-2352-480e-ba51-eab7964a7d3d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '541dcf2b85a145e99c7d0663a0ac0918', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c422a2290a14424da20e2841cbc1741d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:52:17.393549 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09187a1-2352-480e-ba51-eab7964a7d3d service neutron] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:52:17.393831 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09187a1-2352-480e-ba51-eab7964a7d3d service neutron] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:52:17.394107 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09187a1-2352-480e-ba51-eab7964a7d3d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:52:17.396712 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.fernet_utils [None req-a09187a1-2352-480e-ba51-eab7964a7d3d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:52:17.575825 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09187a1-2352-480e-ba51-eab7964a7d3d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:52:17.577366 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09187a1-2352-480e-ba51-eab7964a7d3d service neutron] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:52:17.601919 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 687/1349] 10.222.0.93 () {60 vars in 1365 bytes} [Tue Jul 26 14:52:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 553 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 14:52:24.361168 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bef1d7-94b5-4383-b761-a8a02cf1f922 None None] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:52:24.361970 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bef1d7-94b5-4383-b761-a8a02cf1f922 None None] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:52:24.362143 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bef1d7-94b5-4383-b761-a8a02cf1f922 None None] PATH_INFO: `/` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:52:24.365762 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 663/1350] 10.222.0.93 () {54 vars in 921 bytes} [Tue Jul 26 14:52:24 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:52:24.372277 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7864446f-f3e8-4154-8671-da1f59de79f8 None None] REQUEST_METHOD: `POST` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:52:24.373015 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7864446f-f3e8-4154-8671-da1f59de79f8 None None] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:52:24.373015 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7864446f-f3e8-4154-8671-da1f59de79f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:52:24.503441 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.auth.core [None req-7864446f-f3e8-4154-8671-da1f59de79f8 None None] MFA Rules not processed for user `3e27fe21cc6048d5b9899b938d84ba5f`. Rule list: `[]` (Enabled: `True`). {{(pid=87056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:52:24.506543 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.fernet_utils [None req-7864446f-f3e8-4154-8671-da1f59de79f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:52:24.544165 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:52:24.674937 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 688/1351] 10.222.0.93 () {58 vars in 1018 bytes} [Tue Jul 26 14:52:24 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 304 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 14:52:29.568663 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfb0430-6532-40b5-bc20-8da54ef62cb7 None None] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:52:29.569543 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfb0430-6532-40b5-bc20-8da54ef62cb7 None None] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:52:29.570222 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfb0430-6532-40b5-bc20-8da54ef62cb7 None None] PATH_INFO: `/` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:52:29.573071 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 664/1352] 10.222.0.93 () {54 vars in 921 bytes} [Tue Jul 26 14:52:29 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:52:29.579107 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c9932e-a206-4ed1-b92e-f69b0affec55 None None] REQUEST_METHOD: `POST` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:52:29.579632 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c9932e-a206-4ed1-b92e-f69b0affec55 None None] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:52:29.579712 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c9932e-a206-4ed1-b92e-f69b0affec55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:52:29.679084 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.auth.core [None req-38c9932e-a206-4ed1-b92e-f69b0affec55 None None] MFA Rules not processed for user `3e27fe21cc6048d5b9899b938d84ba5f`. Rule list: `[]` (Enabled: `True`). {{(pid=87056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:52:29.680353 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.fernet_utils [None req-38c9932e-a206-4ed1-b92e-f69b0affec55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:52:29.781244 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:52:29.829943 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 689/1353] 10.222.0.93 () {58 vars in 1018 bytes} [Tue Jul 26 14:52:29 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 14:52:31.412912 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b66b7a4-ce5a-4248-aa68-a19829ec8ce2 None None] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:52:31.413490 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b66b7a4-ce5a-4248-aa68-a19829ec8ce2 None None] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:52:31.414020 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b66b7a4-ce5a-4248-aa68-a19829ec8ce2 None None] PATH_INFO: `/` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:52:31.417043 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 665/1354] 10.222.0.93 () {54 vars in 921 bytes} [Tue Jul 26 14:52:31 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 14:52:31.422812 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa72746-dbf6-4a5f-8867-c609c320e9d2 None None] REQUEST_METHOD: `POST` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:52:31.423738 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa72746-dbf6-4a5f-8867-c609c320e9d2 None None] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:52:31.424018 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa72746-dbf6-4a5f-8867-c609c320e9d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:52:31.531545 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.auth.core [None req-6fa72746-dbf6-4a5f-8867-c609c320e9d2 None None] MFA Rules not processed for user `3e27fe21cc6048d5b9899b938d84ba5f`. Rule list: `[]` (Enabled: `True`). {{(pid=87056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:52:31.532986 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.fernet_utils [None req-6fa72746-dbf6-4a5f-8867-c609c320e9d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:52:31.686036 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 690/1355] 10.222.0.93 () {58 vars in 1018 bytes} [Tue Jul 26 14:52:31 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 14:52:35.723127 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633e9903-3492-4ebf-9ce4-314ec00ceec6 None None] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:52:35.728618 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633e9903-3492-4ebf-9ce4-314ec00ceec6 None None] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:52:35.728618 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633e9903-3492-4ebf-9ce4-314ec00ceec6 None None] PATH_INFO: `/` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:52:35.735030 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 666/1356] 10.222.0.93 () {54 vars in 926 bytes} [Tue Jul 26 14:52:35 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:52:35.739189 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d758d7c4-0fc9-465f-a48d-97fbbdae4ccf None None] REQUEST_METHOD: `POST` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:52:35.740028 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d758d7c4-0fc9-465f-a48d-97fbbdae4ccf None None] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:52:35.740184 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d758d7c4-0fc9-465f-a48d-97fbbdae4ccf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:52:35.818985 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:52:35.875645 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.auth.core [None req-d758d7c4-0fc9-465f-a48d-97fbbdae4ccf None None] MFA Rules not processed for user `e5ef88cc058f425b882bcb87a1e1e75c`. Rule list: `[]` (Enabled: `True`). {{(pid=87056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:52:35.876920 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.fernet_utils [None req-d758d7c4-0fc9-465f-a48d-97fbbdae4ccf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:52:36.008948 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 691/1357] 10.222.0.93 () {58 vars in 1023 bytes} [Tue Jul 26 14:52:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 14:52:36.069917 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc036f4-4b63-44ad-a216-a48d57d9788c None None] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:52:36.072298 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc036f4-4b63-44ad-a216-a48d57d9788c None None] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:52:36.073144 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc036f4-4b63-44ad-a216-a48d57d9788c None None] PATH_INFO: `/` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:52:36.076572 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 667/1358] 10.222.0.93 () {54 vars in 962 bytes} [Tue Jul 26 14:52:36 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:52:36.090441 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc6e207-c29b-44c1-aafd-c922a804b1c2 None None] REQUEST_METHOD: `POST` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:52:36.090716 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc6e207-c29b-44c1-aafd-c922a804b1c2 None None] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:52:36.091139 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc6e207-c29b-44c1-aafd-c922a804b1c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:52:36.247050 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.auth.core [None req-dcc6e207-c29b-44c1-aafd-c922a804b1c2 None None] MFA Rules not processed for user `2e86fe36c9bf49a481c9f15ac7571b88`. Rule list: `[]` (Enabled: `True`). {{(pid=87056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:52:36.249034 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.fernet_utils [None req-dcc6e207-c29b-44c1-aafd-c922a804b1c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:52:36.331859 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:52:36.463522 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 692/1359] 10.222.0.93 () {58 vars in 1059 bytes} [Tue Jul 26 14:52:36 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 374 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 14:52:36.476679 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc036f4-4b63-44ad-a216-a48d57d9788c None None] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:52:36.479447 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.fernet_utils [None req-1bc036f4-4b63-44ad-a216-a48d57d9788c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:52:36.682388 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc036f4-4b63-44ad-a216-a48d57d9788c None None] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:52:36.795615 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:52:36.859999 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ba08dd-c773-4c9a-92a4-e6db70b8d0e7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e86fe36c9bf49a481c9f15ac7571b88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c422a2290a14424da20e2841cbc1741d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:52:36.861516 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ba08dd-c773-4c9a-92a4-e6db70b8d0e7 service nova] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:52:36.862504 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ba08dd-c773-4c9a-92a4-e6db70b8d0e7 service nova] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:52:36.864321 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ba08dd-c773-4c9a-92a4-e6db70b8d0e7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:52:36.868101 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.fernet_utils [None req-23ba08dd-c773-4c9a-92a4-e6db70b8d0e7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:52:37.044735 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ba08dd-c773-4c9a-92a4-e6db70b8d0e7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:52:37.046377 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ba08dd-c773-4c9a-92a4-e6db70b8d0e7 service nova] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:52:37.068651 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 668/1360] 10.222.0.93 () {60 vars in 1365 bytes} [Tue Jul 26 14:52:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 593 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 14:52:40.154998 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9beb8f1-6e21-41de-95ed-80e5604e664e None None] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:52:40.155542 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9beb8f1-6e21-41de-95ed-80e5604e664e None None] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:52:40.156281 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9beb8f1-6e21-41de-95ed-80e5604e664e None None] PATH_INFO: `/` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:52:40.158985 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 693/1361] 10.222.0.93 () {54 vars in 926 bytes} [Tue Jul 26 14:52:40 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:52:40.165418 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0f0350-ae6e-4308-957b-6eaf188a4e4f None None] REQUEST_METHOD: `POST` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:52:40.166279 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0f0350-ae6e-4308-957b-6eaf188a4e4f None None] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:52:40.166279 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0f0350-ae6e-4308-957b-6eaf188a4e4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:52:40.309361 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.auth.core [None req-8d0f0350-ae6e-4308-957b-6eaf188a4e4f None None] MFA Rules not processed for user `e5ef88cc058f425b882bcb87a1e1e75c`. Rule list: `[]` (Enabled: `True`). {{(pid=87055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:52:40.311679 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.fernet_utils [None req-8d0f0350-ae6e-4308-957b-6eaf188a4e4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:52:40.388720 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:52:40.533763 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 669/1362] 10.222.0.93 () {58 vars in 1023 bytes} [Tue Jul 26 14:52:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 369 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 14:52:40.586232 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9beb8f1-6e21-41de-95ed-80e5604e664e None None] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:52:40.587783 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.fernet_utils [None req-c9beb8f1-6e21-41de-95ed-80e5604e664e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:52:40.908223 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9beb8f1-6e21-41de-95ed-80e5604e664e None None] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:52:40.931850 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:52:41.146570 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619d1682-bd86-45da-b5aa-726fd08ff32d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e86fe36c9bf49a481c9f15ac7571b88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c422a2290a14424da20e2841cbc1741d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:52:41.147637 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619d1682-bd86-45da-b5aa-726fd08ff32d service nova] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:52:41.148073 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619d1682-bd86-45da-b5aa-726fd08ff32d service nova] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:52:41.148532 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619d1682-bd86-45da-b5aa-726fd08ff32d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:52:41.151916 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.fernet_utils [None req-619d1682-bd86-45da-b5aa-726fd08ff32d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:52:41.342596 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619d1682-bd86-45da-b5aa-726fd08ff32d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:52:41.347998 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619d1682-bd86-45da-b5aa-726fd08ff32d service nova] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:52:41.386396 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 694/1363] 10.222.0.93 () {60 vars in 1365 bytes} [Tue Jul 26 14:52:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 800 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 14:52:44.389020 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bc764f-bf38-47d6-bcca-1b28f6d70c03 None None] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:52:44.389679 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bc764f-bf38-47d6-bcca-1b28f6d70c03 None None] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:52:44.389679 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bc764f-bf38-47d6-bcca-1b28f6d70c03 None None] PATH_INFO: `/` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:52:44.391277 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 670/1364] 10.222.0.93 () {54 vars in 926 bytes} [Tue Jul 26 14:52:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:52:44.398105 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be93a66c-596b-4a2b-9170-2214f6651c88 None None] REQUEST_METHOD: `POST` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:52:44.398694 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be93a66c-596b-4a2b-9170-2214f6651c88 None None] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:52:44.398694 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be93a66c-596b-4a2b-9170-2214f6651c88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:52:44.418733 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:52:44.522548 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.auth.core [None req-be93a66c-596b-4a2b-9170-2214f6651c88 None None] MFA Rules not processed for user `e5ef88cc058f425b882bcb87a1e1e75c`. Rule list: `[]` (Enabled: `True`). {{(pid=87056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:52:44.523800 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.fernet_utils [None req-be93a66c-596b-4a2b-9170-2214f6651c88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:52:44.665410 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 695/1365] 10.222.0.93 () {58 vars in 1023 bytes} [Tue Jul 26 14:52:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 14:52:44.720341 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1242c0b3-936c-493e-955f-6ee2aca595c1 None None] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:52:44.720774 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1242c0b3-936c-493e-955f-6ee2aca595c1 None None] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:52:44.721316 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1242c0b3-936c-493e-955f-6ee2aca595c1 None None] PATH_INFO: `/` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:52:44.724780 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 671/1366] 10.222.0.93 () {54 vars in 962 bytes} [Tue Jul 26 14:52:44 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:52:44.731411 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a6cf37-3330-4153-83ed-d3f8c685b9b7 None None] REQUEST_METHOD: `POST` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:52:44.731685 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a6cf37-3330-4153-83ed-d3f8c685b9b7 None None] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:52:44.731973 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a6cf37-3330-4153-83ed-d3f8c685b9b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:52:44.873984 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.auth.core [None req-f9a6cf37-3330-4153-83ed-d3f8c685b9b7 None None] MFA Rules not processed for user `2e86fe36c9bf49a481c9f15ac7571b88`. Rule list: `[]` (Enabled: `True`). {{(pid=87056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:52:44.875417 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.fernet_utils [None req-f9a6cf37-3330-4153-83ed-d3f8c685b9b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:52:44.926950 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:52:45.105710 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 696/1367] 10.222.0.93 () {58 vars in 1059 bytes} [Tue Jul 26 14:52:44 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 375 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 14:52:45.120723 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1242c0b3-936c-493e-955f-6ee2aca595c1 None None] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:52:45.122485 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.fernet_utils [None req-1242c0b3-936c-493e-955f-6ee2aca595c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:52:45.337071 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1242c0b3-936c-493e-955f-6ee2aca595c1 None None] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:52:45.379731 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:52:45.408523 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95fd19b-f12c-41dd-b933-c4cf93b84b90 None None] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:52:45.409052 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95fd19b-f12c-41dd-b933-c4cf93b84b90 None None] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:52:45.411387 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95fd19b-f12c-41dd-b933-c4cf93b84b90 None None] PATH_INFO: `/` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:52:45.413017 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 697/1368] 10.222.0.93 () {54 vars in 926 bytes} [Tue Jul 26 14:52:45 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:52:45.419250 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966302d3-6b96-48ba-a086-75acedb38cbd None None] REQUEST_METHOD: `POST` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:52:45.419630 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966302d3-6b96-48ba-a086-75acedb38cbd None None] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:52:45.419917 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966302d3-6b96-48ba-a086-75acedb38cbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:52:45.510572 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.auth.core [None req-966302d3-6b96-48ba-a086-75acedb38cbd None None] MFA Rules not processed for user `e5ef88cc058f425b882bcb87a1e1e75c`. Rule list: `[]` (Enabled: `True`). {{(pid=87056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:52:45.511879 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.fernet_utils [None req-966302d3-6b96-48ba-a086-75acedb38cbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:52:45.568632 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375a8e68-970a-4a4b-ad75-362eb309a381 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e86fe36c9bf49a481c9f15ac7571b88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c422a2290a14424da20e2841cbc1741d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:52:45.569699 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375a8e68-970a-4a4b-ad75-362eb309a381 service nova] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:52:45.570136 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375a8e68-970a-4a4b-ad75-362eb309a381 service nova] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:52:45.570642 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375a8e68-970a-4a4b-ad75-362eb309a381 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:52:45.574128 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.fernet_utils [None req-375a8e68-970a-4a4b-ad75-362eb309a381 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:52:45.703339 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:52:45.714811 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 698/1369] 10.222.0.93 () {58 vars in 1023 bytes} [Tue Jul 26 14:52:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 14:52:45.723188 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375a8e68-970a-4a4b-ad75-362eb309a381 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:52:45.724920 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375a8e68-970a-4a4b-ad75-362eb309a381 service nova] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:52:45.747400 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 672/1370] 10.222.0.93 () {60 vars in 1365 bytes} [Tue Jul 26 14:52:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 627 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 14:52:46.073973 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e935da-215c-49e4-b5c2-b2a4b3e9520e None None] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:52:46.074314 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e935da-215c-49e4-b5c2-b2a4b3e9520e None None] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:52:46.074557 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e935da-215c-49e4-b5c2-b2a4b3e9520e None None] PATH_INFO: `/` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:52:46.076026 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 699/1371] 10.222.0.93 () {54 vars in 964 bytes} [Tue Jul 26 14:52:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:52:46.083687 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf5c098-dcdc-42f0-870b-f1dc57a864b1 None None] REQUEST_METHOD: `POST` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:52:46.084323 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf5c098-dcdc-42f0-870b-f1dc57a864b1 None None] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:52:46.084932 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf5c098-dcdc-42f0-870b-f1dc57a864b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:52:46.150092 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:52:46.243489 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.auth.core [None req-cbf5c098-dcdc-42f0-870b-f1dc57a864b1 None None] MFA Rules not processed for user `6780136eb21e4c8da1950b126284639e`. Rule list: `[]` (Enabled: `True`). {{(pid=87055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:52:46.245182 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.fernet_utils [None req-cbf5c098-dcdc-42f0-870b-f1dc57a864b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:52:46.357389 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 673/1372] 10.222.0.93 () {58 vars in 1061 bytes} [Tue Jul 26 14:52:46 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 14:52:46.367542 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e935da-215c-49e4-b5c2-b2a4b3e9520e None None] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:52:46.369337 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.fernet_utils [None req-67e935da-215c-49e4-b5c2-b2a4b3e9520e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:52:46.529989 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e935da-215c-49e4-b5c2-b2a4b3e9520e None None] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:52:46.637487 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d34e8d-cc53-43f5-b512-f96c5846a158 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6780136eb21e4c8da1950b126284639e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c422a2290a14424da20e2841cbc1741d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:52:46.638524 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d34e8d-cc53-43f5-b512-f96c5846a158 service cinder] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:52:46.639037 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d34e8d-cc53-43f5-b512-f96c5846a158 service cinder] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:52:46.639529 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d34e8d-cc53-43f5-b512-f96c5846a158 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:52:46.642880 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.fernet_utils [None req-14d34e8d-cc53-43f5-b512-f96c5846a158 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:52:46.778541 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:52:46.881308 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d34e8d-cc53-43f5-b512-f96c5846a158 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:52:46.883019 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d34e8d-cc53-43f5-b512-f96c5846a158 service cinder] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:52:46.941250 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 700/1373] 10.222.0.93 () {60 vars in 1365 bytes} [Tue Jul 26 14:52:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 545 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 14:52:48.313390 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fb2f40-8c88-4961-ab62-3277e4b2060d None None] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:52:48.314389 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fb2f40-8c88-4961-ab62-3277e4b2060d None None] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:52:48.314389 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fb2f40-8c88-4961-ab62-3277e4b2060d None None] PATH_INFO: `/` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:52:48.317336 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 674/1374] 10.222.0.93 () {54 vars in 926 bytes} [Tue Jul 26 14:52:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:52:48.323645 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0158a910-2134-4b1b-963a-a17d4bc51c1c None None] REQUEST_METHOD: `POST` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:52:48.324221 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0158a910-2134-4b1b-963a-a17d4bc51c1c None None] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:52:48.324221 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0158a910-2134-4b1b-963a-a17d4bc51c1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:52:48.412841 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.auth.core [None req-0158a910-2134-4b1b-963a-a17d4bc51c1c None None] MFA Rules not processed for user `e5ef88cc058f425b882bcb87a1e1e75c`. Rule list: `[]` (Enabled: `True`). {{(pid=87056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:52:48.414388 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.fernet_utils [None req-0158a910-2134-4b1b-963a-a17d4bc51c1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:52:48.555656 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 701/1375] 10.222.0.93 () {58 vars in 1023 bytes} [Tue Jul 26 14:52:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 14:52:48.604216 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fb2f40-8c88-4961-ab62-3277e4b2060d None None] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:52:48.606287 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.fernet_utils [None req-f9fb2f40-8c88-4961-ab62-3277e4b2060d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:52:48.727781 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:52:48.781288 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fb2f40-8c88-4961-ab62-3277e4b2060d None None] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:52:48.954874 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe36eea-5240-4857-a466-f7b6df2c47a4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e86fe36c9bf49a481c9f15ac7571b88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c422a2290a14424da20e2841cbc1741d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:52:48.955853 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe36eea-5240-4857-a466-f7b6df2c47a4 service nova] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:52:48.956802 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe36eea-5240-4857-a466-f7b6df2c47a4 service nova] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:52:48.957252 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe36eea-5240-4857-a466-f7b6df2c47a4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:52:48.960460 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.fernet_utils [None req-0fe36eea-5240-4857-a466-f7b6df2c47a4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:52:49.078975 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:52:49.096380 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe36eea-5240-4857-a466-f7b6df2c47a4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:52:49.099813 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe36eea-5240-4857-a466-f7b6df2c47a4 service nova] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:52:49.128291 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 675/1376] 10.222.0.93 () {60 vars in 1365 bytes} [Tue Jul 26 14:52:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 525 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 14:52:51.791047 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4775e601-0d76-4009-b37e-3731ad8a9ee2 None None] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:52:51.791596 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4775e601-0d76-4009-b37e-3731ad8a9ee2 None None] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:52:51.791596 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4775e601-0d76-4009-b37e-3731ad8a9ee2 None None] PATH_INFO: `/` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:52:51.793212 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 702/1377] 10.222.0.93 () {54 vars in 926 bytes} [Tue Jul 26 14:52:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:52:51.798852 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86293ee7-935e-4ae6-bb16-5fec75fe5387 None None] REQUEST_METHOD: `POST` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:52:51.799358 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86293ee7-935e-4ae6-bb16-5fec75fe5387 None None] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:52:51.799465 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86293ee7-935e-4ae6-bb16-5fec75fe5387 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:52:51.890170 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.auth.core [None req-86293ee7-935e-4ae6-bb16-5fec75fe5387 None None] MFA Rules not processed for user `e5ef88cc058f425b882bcb87a1e1e75c`. Rule list: `[]` (Enabled: `True`). {{(pid=87055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:52:51.892913 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.fernet_utils [None req-86293ee7-935e-4ae6-bb16-5fec75fe5387 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:52:52.102468 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 676/1378] 10.222.0.93 () {58 vars in 1023 bytes} [Tue Jul 26 14:52:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 14:52:52.149621 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4775e601-0d76-4009-b37e-3731ad8a9ee2 None None] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:52:52.151218 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.fernet_utils [None req-4775e601-0d76-4009-b37e-3731ad8a9ee2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:52:52.154466 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:52:52.363839 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4775e601-0d76-4009-b37e-3731ad8a9ee2 None None] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:52:52.457198 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:52:52.504815 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e88cfd-5b8c-44ce-bd59-24abc290b643 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e86fe36c9bf49a481c9f15ac7571b88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c422a2290a14424da20e2841cbc1741d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:52:52.505457 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e88cfd-5b8c-44ce-bd59-24abc290b643 service nova] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:52:52.506375 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e88cfd-5b8c-44ce-bd59-24abc290b643 service nova] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:52:52.506732 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e88cfd-5b8c-44ce-bd59-24abc290b643 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:52:52.508590 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.fernet_utils [None req-65e88cfd-5b8c-44ce-bd59-24abc290b643 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:52:52.640514 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e88cfd-5b8c-44ce-bd59-24abc290b643 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:52:52.642184 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e88cfd-5b8c-44ce-bd59-24abc290b643 service nova] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:52:52.684446 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 703/1379] 10.222.0.93 () {60 vars in 1365 bytes} [Tue Jul 26 14:52:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 535 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 14:52:55.343403 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bdedc8-12b8-4011-ae1f-a21310fbaec8 None None] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:52:55.344432 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bdedc8-12b8-4011-ae1f-a21310fbaec8 None None] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:52:55.344432 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bdedc8-12b8-4011-ae1f-a21310fbaec8 None None] PATH_INFO: `/` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:52:55.345892 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 677/1380] 10.222.0.93 () {54 vars in 926 bytes} [Tue Jul 26 14:52:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 14:52:55.351841 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a1d5bf-c197-4922-ab00-48d7ad9eb2d7 None None] REQUEST_METHOD: `POST` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:52:55.352614 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a1d5bf-c197-4922-ab00-48d7ad9eb2d7 None None] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:52:55.352614 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a1d5bf-c197-4922-ab00-48d7ad9eb2d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:52:55.462655 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.auth.core [None req-35a1d5bf-c197-4922-ab00-48d7ad9eb2d7 None None] MFA Rules not processed for user `e5ef88cc058f425b882bcb87a1e1e75c`. Rule list: `[]` (Enabled: `True`). {{(pid=87056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:52:55.464256 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.fernet_utils [None req-35a1d5bf-c197-4922-ab00-48d7ad9eb2d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:52:55.522277 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:52:55.617403 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 704/1381] 10.222.0.93 () {58 vars in 1023 bytes} [Tue Jul 26 14:52:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 14:52:55.700169 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bdedc8-12b8-4011-ae1f-a21310fbaec8 None None] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:52:55.702015 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.fernet_utils [None req-50bdedc8-12b8-4011-ae1f-a21310fbaec8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:52:55.807017 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:52:55.949501 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bdedc8-12b8-4011-ae1f-a21310fbaec8 None None] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:52:56.156454 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818469bf-16ce-4d9e-8980-999616916f89 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e86fe36c9bf49a481c9f15ac7571b88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c422a2290a14424da20e2841cbc1741d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:52:56.156454 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818469bf-16ce-4d9e-8980-999616916f89 service nova] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:52:56.156454 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818469bf-16ce-4d9e-8980-999616916f89 service nova] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:52:56.156454 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818469bf-16ce-4d9e-8980-999616916f89 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:52:56.159079 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.fernet_utils [None req-818469bf-16ce-4d9e-8980-999616916f89 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:52:56.196495 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:52:56.330479 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818469bf-16ce-4d9e-8980-999616916f89 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:52:56.332995 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818469bf-16ce-4d9e-8980-999616916f89 service nova] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:52:56.365445 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 678/1382] 10.222.0.93 () {60 vars in 1365 bytes} [Tue Jul 26 14:52:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 666 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 14:52:58.925805 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce232d21-48a3-4a9f-8d12-44f5f8404af5 None None] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:52:58.926709 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce232d21-48a3-4a9f-8d12-44f5f8404af5 None None] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:52:58.926709 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce232d21-48a3-4a9f-8d12-44f5f8404af5 None None] PATH_INFO: `/` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:52:58.928604 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 705/1383] 10.222.0.93 () {54 vars in 926 bytes} [Tue Jul 26 14:52:58 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:52:58.939701 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216a7684-1cd4-44de-adf7-89e3b6d0a899 None None] REQUEST_METHOD: `POST` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:52:58.939701 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216a7684-1cd4-44de-adf7-89e3b6d0a899 None None] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:52:58.939701 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216a7684-1cd4-44de-adf7-89e3b6d0a899 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:52:59.033367 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.auth.core [None req-216a7684-1cd4-44de-adf7-89e3b6d0a899 None None] MFA Rules not processed for user `e5ef88cc058f425b882bcb87a1e1e75c`. Rule list: `[]` (Enabled: `True`). {{(pid=87055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:52:59.035346 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.fernet_utils [None req-216a7684-1cd4-44de-adf7-89e3b6d0a899 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:52:59.195825 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:52:59.204086 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 679/1384] 10.222.0.93 () {58 vars in 1023 bytes} [Tue Jul 26 14:52:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 14:52:59.280893 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce232d21-48a3-4a9f-8d12-44f5f8404af5 None None] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:52:59.284654 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.fernet_utils [None req-ce232d21-48a3-4a9f-8d12-44f5f8404af5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:52:59.549867 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce232d21-48a3-4a9f-8d12-44f5f8404af5 None None] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:52:59.584689 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:52:59.781737 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9aa080e-5375-4f45-94e4-2db0d7b01e55 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e86fe36c9bf49a481c9f15ac7571b88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c422a2290a14424da20e2841cbc1741d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:52:59.782610 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9aa080e-5375-4f45-94e4-2db0d7b01e55 service nova] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:52:59.783025 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9aa080e-5375-4f45-94e4-2db0d7b01e55 service nova] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:52:59.783409 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9aa080e-5375-4f45-94e4-2db0d7b01e55 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:52:59.785769 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.fernet_utils [None req-d9aa080e-5375-4f45-94e4-2db0d7b01e55 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:52:59.937518 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9aa080e-5375-4f45-94e4-2db0d7b01e55 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:52:59.941074 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9aa080e-5375-4f45-94e4-2db0d7b01e55 service nova] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:52:59.969355 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 706/1385] 10.222.0.93 () {60 vars in 1365 bytes} [Tue Jul 26 14:52:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 689 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 14:53:02.475282 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3f94b2-17ce-4b8a-a55b-80a0465369db None None] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:53:02.476675 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3f94b2-17ce-4b8a-a55b-80a0465369db None None] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:53:02.476675 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3f94b2-17ce-4b8a-a55b-80a0465369db None None] PATH_INFO: `/` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:53:02.477805 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 680/1386] 10.222.0.93 () {54 vars in 926 bytes} [Tue Jul 26 14:53:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 14:53:02.485476 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad267a90-8386-411c-8956-2c6471974d38 None None] REQUEST_METHOD: `POST` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:53:02.486098 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad267a90-8386-411c-8956-2c6471974d38 None None] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:53:02.486483 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad267a90-8386-411c-8956-2c6471974d38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:53:02.563865 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:53:02.607589 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.auth.core [None req-ad267a90-8386-411c-8956-2c6471974d38 None None] MFA Rules not processed for user `e5ef88cc058f425b882bcb87a1e1e75c`. Rule list: `[]` (Enabled: `True`). {{(pid=87056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:53:02.608891 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.fernet_utils [None req-ad267a90-8386-411c-8956-2c6471974d38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:53:02.754122 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 707/1387] 10.222.0.93 () {58 vars in 1023 bytes} [Tue Jul 26 14:53:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 14:53:02.829528 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3f94b2-17ce-4b8a-a55b-80a0465369db None None] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:53:02.831501 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.fernet_utils [None req-aa3f94b2-17ce-4b8a-a55b-80a0465369db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:53:03.040296 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3f94b2-17ce-4b8a-a55b-80a0465369db None None] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:53:03.126349 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:53:03.199585 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f03cc52-5a6e-41aa-b561-d42a0f19eb9e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e86fe36c9bf49a481c9f15ac7571b88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c422a2290a14424da20e2841cbc1741d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:53:03.199967 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f03cc52-5a6e-41aa-b561-d42a0f19eb9e service nova] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:53:03.200396 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f03cc52-5a6e-41aa-b561-d42a0f19eb9e service nova] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:53:03.200796 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f03cc52-5a6e-41aa-b561-d42a0f19eb9e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:53:03.202737 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.fernet_utils [None req-5f03cc52-5a6e-41aa-b561-d42a0f19eb9e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:53:03.317626 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f03cc52-5a6e-41aa-b561-d42a0f19eb9e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:53:03.319419 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f03cc52-5a6e-41aa-b561-d42a0f19eb9e service nova] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:53:03.343665 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 681/1388] 10.222.0.93 () {60 vars in 1365 bytes} [Tue Jul 26 14:53:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 515 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 14:53:04.423183 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d02509-0c40-4713-aef4-2ecfbf761618 None None] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:53:04.424053 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d02509-0c40-4713-aef4-2ecfbf761618 None None] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:53:04.424053 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d02509-0c40-4713-aef4-2ecfbf761618 None None] PATH_INFO: `/` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:53:04.426028 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 708/1389] 10.222.0.93 () {54 vars in 926 bytes} [Tue Jul 26 14:53:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:53:04.431884 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7493387-fb07-471a-a54e-1cd98402fd2e None None] REQUEST_METHOD: `POST` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:53:04.432722 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7493387-fb07-471a-a54e-1cd98402fd2e None None] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:53:04.432722 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7493387-fb07-471a-a54e-1cd98402fd2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:53:04.520411 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.auth.core [None req-b7493387-fb07-471a-a54e-1cd98402fd2e None None] MFA Rules not processed for user `e5ef88cc058f425b882bcb87a1e1e75c`. Rule list: `[]` (Enabled: `True`). {{(pid=87055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:53:04.522044 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.fernet_utils [None req-b7493387-fb07-471a-a54e-1cd98402fd2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:53:04.572897 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:53:04.680525 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 682/1390] 10.222.0.93 () {58 vars in 1023 bytes} [Tue Jul 26 14:53:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 14:53:04.753970 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41fa8d2-e7b7-4d10-a839-9ce45bdd3d36 None None] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:53:04.754483 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41fa8d2-e7b7-4d10-a839-9ce45bdd3d36 None None] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:53:04.754980 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41fa8d2-e7b7-4d10-a839-9ce45bdd3d36 None None] PATH_INFO: `/` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:53:04.757727 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 709/1391] 10.222.0.93 () {54 vars in 966 bytes} [Tue Jul 26 14:53:04 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:53:04.766142 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055c96e7-961b-4ed0-a9d0-b8b1ee1dd4c8 None None] REQUEST_METHOD: `POST` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:53:04.766584 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055c96e7-961b-4ed0-a9d0-b8b1ee1dd4c8 None None] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:53:04.766996 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055c96e7-961b-4ed0-a9d0-b8b1ee1dd4c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:53:04.873127 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.auth.core [None req-055c96e7-961b-4ed0-a9d0-b8b1ee1dd4c8 None None] MFA Rules not processed for user `38ab40a64fb7419ebb0476e0fa09a2bb`. Rule list: `[]` (Enabled: `True`). {{(pid=87055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:53:04.874574 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.fernet_utils [None req-055c96e7-961b-4ed0-a9d0-b8b1ee1dd4c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:53:05.013848 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 683/1392] 10.222.0.93 () {58 vars in 1063 bytes} [Tue Jul 26 14:53:04 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 14:53:05.022289 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41fa8d2-e7b7-4d10-a839-9ce45bdd3d36 None None] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:53:05.026728 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.fernet_utils [None req-f41fa8d2-e7b7-4d10-a839-9ce45bdd3d36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:53:05.171360 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41fa8d2-e7b7-4d10-a839-9ce45bdd3d36 None None] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:53:05.181287 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:53:05.282374 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2d8614-c592-4464-aadb-76a23b042011 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38ab40a64fb7419ebb0476e0fa09a2bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c422a2290a14424da20e2841cbc1741d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:53:05.283452 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2d8614-c592-4464-aadb-76a23b042011 service glance] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:53:05.284006 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2d8614-c592-4464-aadb-76a23b042011 service glance] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:53:05.284506 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2d8614-c592-4464-aadb-76a23b042011 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:53:05.287933 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.fernet_utils [None req-6d2d8614-c592-4464-aadb-76a23b042011 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:53:05.465371 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2d8614-c592-4464-aadb-76a23b042011 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:53:05.467170 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2d8614-c592-4464-aadb-76a23b042011 service glance] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:53:05.491543 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 710/1393] 10.222.0.93 () {60 vars in 1365 bytes} [Tue Jul 26 14:53:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 470 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 14:53:05.955140 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6136af6b-785b-4402-a76e-db33892fdd09 None None] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:53:05.956807 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6136af6b-785b-4402-a76e-db33892fdd09 None None] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:53:05.957293 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6136af6b-785b-4402-a76e-db33892fdd09 None None] PATH_INFO: `/` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:53:05.959827 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 684/1394] 10.222.0.93 () {54 vars in 926 bytes} [Tue Jul 26 14:53:05 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:53:05.968286 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76ba49b-f656-4d51-abf3-cbd7828e1e3c None None] REQUEST_METHOD: `POST` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:53:05.968664 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76ba49b-f656-4d51-abf3-cbd7828e1e3c None None] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:53:05.969016 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76ba49b-f656-4d51-abf3-cbd7828e1e3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:53:06.025335 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:53:06.054680 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.auth.core [None req-e76ba49b-f656-4d51-abf3-cbd7828e1e3c None None] MFA Rules not processed for user `e5ef88cc058f425b882bcb87a1e1e75c`. Rule list: `[]` (Enabled: `True`). {{(pid=87056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:53:06.055945 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.fernet_utils [None req-e76ba49b-f656-4d51-abf3-cbd7828e1e3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:53:06.173273 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 711/1395] 10.222.0.93 () {58 vars in 1023 bytes} [Tue Jul 26 14:53:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 14:53:06.220349 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6136af6b-785b-4402-a76e-db33892fdd09 None None] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:53:06.222786 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.fernet_utils [None req-6136af6b-785b-4402-a76e-db33892fdd09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:53:06.260076 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:53:06.468869 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6136af6b-785b-4402-a76e-db33892fdd09 None None] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:53:06.509570 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c9ae00-02cf-413f-b94b-cb5dce105f18 None None] REQUEST_METHOD: `POST` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:53:06.510163 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c9ae00-02cf-413f-b94b-cb5dce105f18 None None] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:53:06.510163 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c9ae00-02cf-413f-b94b-cb5dce105f18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:53:06.589954 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.auth.core [None req-96c9ae00-02cf-413f-b94b-cb5dce105f18 None None] MFA Rules not processed for user `0205dfcfb5e5404c95aefc1f45a1e1e6`. Rule list: `[]` (Enabled: `True`). {{(pid=87056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:53:06.591611 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.fernet_utils [None req-96c9ae00-02cf-413f-b94b-cb5dce105f18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:53:06.645647 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:53:06.660390 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3384262d-ea61-48d9-8953-0412f8d0cacb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e86fe36c9bf49a481c9f15ac7571b88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c422a2290a14424da20e2841cbc1741d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:53:06.661008 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3384262d-ea61-48d9-8953-0412f8d0cacb service nova] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:53:06.661292 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3384262d-ea61-48d9-8953-0412f8d0cacb service nova] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:53:06.661567 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3384262d-ea61-48d9-8953-0412f8d0cacb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:53:06.663530 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.fernet_utils [None req-3384262d-ea61-48d9-8953-0412f8d0cacb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:53:06.669381 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:53:06.703980 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 712/1396] 10.222.0.93 () {58 vars in 1009 bytes} [Tue Jul 26 14:53:06 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 14:53:06.760966 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db011dd8-b1e3-44ed-b287-7c00d2b41746 None None] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:53:06.769793 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db011dd8-b1e3-44ed-b287-7c00d2b41746 None None] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:53:06.769793 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db011dd8-b1e3-44ed-b287-7c00d2b41746 None None] PATH_INFO: `/` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:53:06.769793 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 713/1397] 10.222.0.93 () {54 vars in 943 bytes} [Tue Jul 26 14:53:06 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:53:06.773420 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c7ce5b-49bb-41fb-89f2-0ff78dd1a6b4 None None] REQUEST_METHOD: `POST` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:53:06.773868 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c7ce5b-49bb-41fb-89f2-0ff78dd1a6b4 None None] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:53:06.774332 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c7ce5b-49bb-41fb-89f2-0ff78dd1a6b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:53:06.784312 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3384262d-ea61-48d9-8953-0412f8d0cacb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:53:06.786134 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3384262d-ea61-48d9-8953-0412f8d0cacb service nova] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:53:06.806909 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 685/1398] 10.222.0.93 () {60 vars in 1365 bytes} [Tue Jul 26 14:53:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 587 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 14:53:06.870630 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.auth.core [None req-c2c7ce5b-49bb-41fb-89f2-0ff78dd1a6b4 None None] MFA Rules not processed for user `b914b2ba87e74def85f9694e1141e00b`. Rule list: `[]` (Enabled: `True`). {{(pid=87056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:53:06.872000 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.fernet_utils [None req-c2c7ce5b-49bb-41fb-89f2-0ff78dd1a6b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:53:07.007661 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 714/1399] 10.222.0.93 () {58 vars in 1040 bytes} [Tue Jul 26 14:53:06 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 14:53:07.017822 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3384262d-ea61-48d9-8953-0412f8d0cacb service nova] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:53:07.019524 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.fernet_utils [None req-3384262d-ea61-48d9-8953-0412f8d0cacb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:53:07.135457 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3384262d-ea61-48d9-8953-0412f8d0cacb service nova] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:53:07.172947 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:53:07.265479 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28f9b27-e4c2-4294-8782-d158b0a3a487 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b914b2ba87e74def85f9694e1141e00b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c422a2290a14424da20e2841cbc1741d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:53:07.266033 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28f9b27-e4c2-4294-8782-d158b0a3a487 service swift] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:53:07.266354 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28f9b27-e4c2-4294-8782-d158b0a3a487 service swift] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:53:07.266635 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28f9b27-e4c2-4294-8782-d158b0a3a487 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:53:07.268556 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.fernet_utils [None req-a28f9b27-e4c2-4294-8782-d158b0a3a487 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:53:07.374844 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28f9b27-e4c2-4294-8782-d158b0a3a487 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:53:07.376555 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28f9b27-e4c2-4294-8782-d158b0a3a487 service swift] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:53:07.386152 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 686/1400] 10.222.0.93 () {60 vars in 1384 bytes} [Tue Jul 26 14:53:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 26 14:53:09.141062 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fb9f1a-7e88-46f2-b6f8-cddc4b4f2eaa None None] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:53:09.141700 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fb9f1a-7e88-46f2-b6f8-cddc4b4f2eaa None None] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:53:09.141700 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fb9f1a-7e88-46f2-b6f8-cddc4b4f2eaa None None] PATH_INFO: `/` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:53:09.144167 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 715/1401] 10.222.0.93 () {54 vars in 926 bytes} [Tue Jul 26 14:53:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:53:09.150628 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d690d29b-bf3a-4208-9765-8d0a36a9b434 None None] REQUEST_METHOD: `POST` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:53:09.151500 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d690d29b-bf3a-4208-9765-8d0a36a9b434 None None] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:53:09.151690 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d690d29b-bf3a-4208-9765-8d0a36a9b434 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:53:09.271830 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.auth.core [None req-d690d29b-bf3a-4208-9765-8d0a36a9b434 None None] MFA Rules not processed for user `e5ef88cc058f425b882bcb87a1e1e75c`. Rule list: `[]` (Enabled: `True`). {{(pid=87055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:53:09.273322 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.fernet_utils [None req-d690d29b-bf3a-4208-9765-8d0a36a9b434 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:53:09.303160 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:53:09.475537 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 687/1402] 10.222.0.93 () {58 vars in 1023 bytes} [Tue Jul 26 14:53:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 326 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 14:53:09.545223 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fb9f1a-7e88-46f2-b6f8-cddc4b4f2eaa None None] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:53:09.547354 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.fernet_utils [None req-f7fb9f1a-7e88-46f2-b6f8-cddc4b4f2eaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:53:09.617407 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:53:09.799485 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fb9f1a-7e88-46f2-b6f8-cddc4b4f2eaa None None] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:53:09.991604 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:53:09.997332 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf598791-f401-4cdd-87cf-6de7dcdc65b1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e86fe36c9bf49a481c9f15ac7571b88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c422a2290a14424da20e2841cbc1741d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:53:09.998756 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf598791-f401-4cdd-87cf-6de7dcdc65b1 service nova] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:53:10.007878 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf598791-f401-4cdd-87cf-6de7dcdc65b1 service nova] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:53:10.007878 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf598791-f401-4cdd-87cf-6de7dcdc65b1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:53:10.007878 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.fernet_utils [None req-cf598791-f401-4cdd-87cf-6de7dcdc65b1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:53:10.191976 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf598791-f401-4cdd-87cf-6de7dcdc65b1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:53:10.195772 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf598791-f401-4cdd-87cf-6de7dcdc65b1 service nova] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:53:10.243062 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 716/1403] 10.222.0.93 () {60 vars in 1365 bytes} [Tue Jul 26 14:53:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 698 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 14:53:12.969706 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a80851-15fd-4ec2-9db6-96f93b48b658 None None] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:53:12.970593 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a80851-15fd-4ec2-9db6-96f93b48b658 None None] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:53:12.970593 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a80851-15fd-4ec2-9db6-96f93b48b658 None None] PATH_INFO: `/` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:53:12.972357 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 688/1404] 10.222.0.93 () {54 vars in 926 bytes} [Tue Jul 26 14:53:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 14:53:12.979244 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10e292f-fe73-4064-9f97-c820eaa58943 None None] REQUEST_METHOD: `POST` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:53:12.980564 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10e292f-fe73-4064-9f97-c820eaa58943 None None] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:53:12.980963 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10e292f-fe73-4064-9f97-c820eaa58943 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:53:13.076389 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.auth.core [None req-a10e292f-fe73-4064-9f97-c820eaa58943 None None] MFA Rules not processed for user `e5ef88cc058f425b882bcb87a1e1e75c`. Rule list: `[]` (Enabled: `True`). {{(pid=87056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:53:13.077682 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.fernet_utils [None req-a10e292f-fe73-4064-9f97-c820eaa58943 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:53:13.189091 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:53:13.238557 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 717/1405] 10.222.0.93 () {58 vars in 1023 bytes} [Tue Jul 26 14:53:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 14:53:13.285981 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a80851-15fd-4ec2-9db6-96f93b48b658 None None] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:53:13.288608 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.fernet_utils [None req-d8a80851-15fd-4ec2-9db6-96f93b48b658 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:53:13.526324 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:53:13.534533 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a80851-15fd-4ec2-9db6-96f93b48b658 None None] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:53:13.685096 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a61906-7948-45a8-8bb4-b385c8adf05a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e86fe36c9bf49a481c9f15ac7571b88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c422a2290a14424da20e2841cbc1741d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:53:13.686371 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a61906-7948-45a8-8bb4-b385c8adf05a service nova] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:53:13.686863 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a61906-7948-45a8-8bb4-b385c8adf05a service nova] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:53:13.687445 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a61906-7948-45a8-8bb4-b385c8adf05a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:53:13.691360 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.fernet_utils [None req-79a61906-7948-45a8-8bb4-b385c8adf05a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:53:13.827543 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a61906-7948-45a8-8bb4-b385c8adf05a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:53:13.829048 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a61906-7948-45a8-8bb4-b385c8adf05a service nova] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:53:13.853951 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:53:13.860003 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 689/1406] 10.222.0.93 () {60 vars in 1365 bytes} [Tue Jul 26 14:53:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 575 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 14:53:16.235818 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea19678-c315-4456-ab46-3be1df343589 None None] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:53:16.237188 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea19678-c315-4456-ab46-3be1df343589 None None] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:53:16.237188 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea19678-c315-4456-ab46-3be1df343589 None None] PATH_INFO: `/` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:53:16.244011 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f778e53-6a2d-456f-bf5c-68f1bf436937 None None] REQUEST_METHOD: `POST` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:53:16.244848 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f778e53-6a2d-456f-bf5c-68f1bf436937 None None] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:53:16.244848 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f778e53-6a2d-456f-bf5c-68f1bf436937 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:53:16.246551 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 718/1407] 10.222.0.93 () {54 vars in 926 bytes} [Tue Jul 26 14:53:16 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 14:53:16.368650 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.auth.core [None req-9f778e53-6a2d-456f-bf5c-68f1bf436937 None None] MFA Rules not processed for user `e5ef88cc058f425b882bcb87a1e1e75c`. Rule list: `[]` (Enabled: `True`). {{(pid=87055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:53:16.370582 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.fernet_utils [None req-9f778e53-6a2d-456f-bf5c-68f1bf436937 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:53:16.573056 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 690/1408] 10.222.0.93 () {58 vars in 1023 bytes} [Tue Jul 26 14:53:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 330 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 14:53:16.635331 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea19678-c315-4456-ab46-3be1df343589 None None] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:53:16.637619 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.fernet_utils [None req-6ea19678-c315-4456-ab46-3be1df343589 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:53:16.919263 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea19678-c315-4456-ab46-3be1df343589 None None] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:53:17.041017 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:53:17.163081 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c14a33e-8bab-43e1-8882-0ad56c30fe5b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e86fe36c9bf49a481c9f15ac7571b88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c422a2290a14424da20e2841cbc1741d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:53:17.164146 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c14a33e-8bab-43e1-8882-0ad56c30fe5b service nova] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:53:17.164630 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c14a33e-8bab-43e1-8882-0ad56c30fe5b service nova] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:53:17.164999 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c14a33e-8bab-43e1-8882-0ad56c30fe5b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:53:17.167801 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.fernet_utils [None req-6c14a33e-8bab-43e1-8882-0ad56c30fe5b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:53:17.357730 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c14a33e-8bab-43e1-8882-0ad56c30fe5b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:53:17.362274 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c14a33e-8bab-43e1-8882-0ad56c30fe5b service nova] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:53:17.409494 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 719/1409] 10.222.0.93 () {60 vars in 1365 bytes} [Tue Jul 26 14:53:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 775 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 14:53:26.569035 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=65 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:53:27.403772 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=72 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:53:37.408055 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4a4f05-0598-41f0-993b-c4920317d228 None None] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:53:37.408737 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4a4f05-0598-41f0-993b-c4920317d228 None None] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:53:37.409062 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4a4f05-0598-41f0-993b-c4920317d228 None None] PATH_INFO: `/` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:53:37.411535 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 691/1410] 10.222.0.93 () {54 vars in 918 bytes} [Tue Jul 26 14:53:37 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:53:37.419962 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d37429-72ae-4ec8-8bfb-ff05a02244d6 None None] REQUEST_METHOD: `POST` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:53:37.420576 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d37429-72ae-4ec8-8bfb-ff05a02244d6 None None] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:53:37.420576 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d37429-72ae-4ec8-8bfb-ff05a02244d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:53:37.520613 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.auth.core [None req-14d37429-72ae-4ec8-8bfb-ff05a02244d6 None None] MFA Rules not processed for user `3e27fe21cc6048d5b9899b938d84ba5f`. Rule list: `[]` (Enabled: `True`). {{(pid=87056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:53:37.522838 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.fernet_utils [None req-14d37429-72ae-4ec8-8bfb-ff05a02244d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:53:37.673647 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 720/1411] 10.222.0.93 () {58 vars in 1015 bytes} [Tue Jul 26 14:53:37 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 14:53:37.690002 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6712f5-cae0-4aef-99f9-c44344181f69 None None] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:53:37.690341 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6712f5-cae0-4aef-99f9-c44344181f69 None None] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:53:37.690587 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6712f5-cae0-4aef-99f9-c44344181f69 None None] PATH_INFO: `/` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:53:37.692039 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 692/1412] 10.222.0.93 () {54 vars in 918 bytes} [Tue Jul 26 14:53:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 14:53:37.700183 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f59a6b-1c52-4f57-b829-838b506bd688 None None] REQUEST_METHOD: `POST` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:53:37.700642 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f59a6b-1c52-4f57-b829-838b506bd688 None None] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:53:37.700962 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f59a6b-1c52-4f57-b829-838b506bd688 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:53:37.788893 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:53:37.792406 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.auth.core [None req-37f59a6b-1c52-4f57-b829-838b506bd688 None None] MFA Rules not processed for user `2e86fe36c9bf49a481c9f15ac7571b88`. Rule list: `[]` (Enabled: `True`). {{(pid=87056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:53:37.793699 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.fernet_utils [None req-37f59a6b-1c52-4f57-b829-838b506bd688 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:53:37.963397 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 721/1413] 10.222.0.93 () {58 vars in 1015 bytes} [Tue Jul 26 14:53:37 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 14:53:40.924543 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1391900-2d20-4287-a387-119d61e4c1ea None None] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:53:40.925159 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1391900-2d20-4287-a387-119d61e4c1ea None None] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:53:40.925159 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1391900-2d20-4287-a387-119d61e4c1ea None None] PATH_INFO: `/` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:53:40.926654 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 693/1414] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 26 14:53:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 14:53:40.935280 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8395e24a-7869-4fb9-a103-0b70d8b5021a None None] REQUEST_METHOD: `POST` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:53:40.935883 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8395e24a-7869-4fb9-a103-0b70d8b5021a None None] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:53:40.935990 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8395e24a-7869-4fb9-a103-0b70d8b5021a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:53:41.020268 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.auth.core [None req-8395e24a-7869-4fb9-a103-0b70d8b5021a None None] MFA Rules not processed for user `e5ef88cc058f425b882bcb87a1e1e75c`. Rule list: `[]` (Enabled: `True`). {{(pid=87056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:53:41.021591 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.fernet_utils [None req-8395e24a-7869-4fb9-a103-0b70d8b5021a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:53:41.116074 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:53:41.179224 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 722/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 26 14:53:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 14:53:41.249665 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1391900-2d20-4287-a387-119d61e4c1ea None None] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:53:41.251777 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.fernet_utils [None req-e1391900-2d20-4287-a387-119d61e4c1ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:53:41.438780 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1391900-2d20-4287-a387-119d61e4c1ea None None] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:53:41.529239 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:53:41.579105 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fffbc4-aa0a-4410-848f-579aa6280d1d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e86fe36c9bf49a481c9f15ac7571b88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c422a2290a14424da20e2841cbc1741d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:53:41.579808 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fffbc4-aa0a-4410-848f-579aa6280d1d service nova] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:53:41.580126 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fffbc4-aa0a-4410-848f-579aa6280d1d service nova] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:53:41.580479 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fffbc4-aa0a-4410-848f-579aa6280d1d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:53:41.582272 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.fernet_utils [None req-62fffbc4-aa0a-4410-848f-579aa6280d1d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:53:41.692951 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fffbc4-aa0a-4410-848f-579aa6280d1d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:53:41.695201 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fffbc4-aa0a-4410-848f-579aa6280d1d service nova] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:53:41.716852 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 694/1416] 10.222.0.93 () {60 vars in 1365 bytes} [Tue Jul 26 14:53:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 468 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 14:53:42.765896 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709e7567-6d7b-46b5-abcf-e0892766f149 None None] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:53:42.767163 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709e7567-6d7b-46b5-abcf-e0892766f149 None None] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:53:42.767350 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709e7567-6d7b-46b5-abcf-e0892766f149 None None] PATH_INFO: `/` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:53:42.769268 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 723/1417] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 26 14:53:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:53:42.775335 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082e9775-fd53-43de-a45a-bb3f4178b0a2 None None] REQUEST_METHOD: `POST` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:53:42.775909 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082e9775-fd53-43de-a45a-bb3f4178b0a2 None None] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:53:42.775909 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082e9775-fd53-43de-a45a-bb3f4178b0a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:53:42.875243 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.auth.core [None req-082e9775-fd53-43de-a45a-bb3f4178b0a2 None None] MFA Rules not processed for user `e5ef88cc058f425b882bcb87a1e1e75c`. Rule list: `[]` (Enabled: `True`). {{(pid=87055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:53:42.876894 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.fernet_utils [None req-082e9775-fd53-43de-a45a-bb3f4178b0a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:53:42.911242 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:53:42.999861 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 695/1418] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 26 14:53:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 14:53:43.161115 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709e7567-6d7b-46b5-abcf-e0892766f149 None None] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:53:43.162825 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.fernet_utils [None req-709e7567-6d7b-46b5-abcf-e0892766f149 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:53:43.341146 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709e7567-6d7b-46b5-abcf-e0892766f149 None None] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:53:43.392217 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:53:43.490365 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f22aa16-3ffb-4993-82b4-06b1eb0deede service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e86fe36c9bf49a481c9f15ac7571b88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c422a2290a14424da20e2841cbc1741d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:53:43.491179 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f22aa16-3ffb-4993-82b4-06b1eb0deede service nova] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:53:43.491465 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f22aa16-3ffb-4993-82b4-06b1eb0deede service nova] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:53:43.491740 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f22aa16-3ffb-4993-82b4-06b1eb0deede service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:53:43.493512 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.fernet_utils [None req-3f22aa16-3ffb-4993-82b4-06b1eb0deede service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:53:43.602381 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f22aa16-3ffb-4993-82b4-06b1eb0deede service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:53:43.603910 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f22aa16-3ffb-4993-82b4-06b1eb0deede service nova] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:53:43.625914 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 724/1419] 10.222.0.93 () {60 vars in 1365 bytes} [Tue Jul 26 14:53:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 465 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 14:53:44.588747 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038b5441-d0c8-47f5-9570-470d5a10d8d7 None None] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:53:44.589333 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038b5441-d0c8-47f5-9570-470d5a10d8d7 None None] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:53:44.589333 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038b5441-d0c8-47f5-9570-470d5a10d8d7 None None] PATH_INFO: `/` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:53:44.590833 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 696/1420] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 26 14:53:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 14:53:44.598195 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6211a014-9af4-4ae7-8f31-323a94ee3cc9 None None] REQUEST_METHOD: `POST` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:53:44.598844 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6211a014-9af4-4ae7-8f31-323a94ee3cc9 None None] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:53:44.599231 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6211a014-9af4-4ae7-8f31-323a94ee3cc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:53:44.707187 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:53:44.734614 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.auth.core [None req-6211a014-9af4-4ae7-8f31-323a94ee3cc9 None None] MFA Rules not processed for user `e5ef88cc058f425b882bcb87a1e1e75c`. Rule list: `[]` (Enabled: `True`). {{(pid=87056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:53:44.736124 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.fernet_utils [None req-6211a014-9af4-4ae7-8f31-323a94ee3cc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:53:44.850878 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 725/1421] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 26 14:53:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 14:53:45.010433 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038b5441-d0c8-47f5-9570-470d5a10d8d7 None None] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:53:45.011910 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.fernet_utils [None req-038b5441-d0c8-47f5-9570-470d5a10d8d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:53:45.272671 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038b5441-d0c8-47f5-9570-470d5a10d8d7 None None] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:53:45.297058 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:53:45.443670 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a6e69e-9231-4bf5-8ff2-12b8cb865aab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e86fe36c9bf49a481c9f15ac7571b88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c422a2290a14424da20e2841cbc1741d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:53:45.444301 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a6e69e-9231-4bf5-8ff2-12b8cb865aab service nova] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:53:45.444581 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a6e69e-9231-4bf5-8ff2-12b8cb865aab service nova] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:53:45.444853 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a6e69e-9231-4bf5-8ff2-12b8cb865aab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:53:45.446611 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.fernet_utils [None req-d8a6e69e-9231-4bf5-8ff2-12b8cb865aab service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:53:45.565781 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a6e69e-9231-4bf5-8ff2-12b8cb865aab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:53:45.568741 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a6e69e-9231-4bf5-8ff2-12b8cb865aab service nova] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:53:45.596075 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 697/1422] 10.222.0.93 () {60 vars in 1365 bytes} [Tue Jul 26 14:53:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 586 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 14:53:46.559702 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea69ac84-ed7b-44d8-aad1-f5103b28eb13 None None] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:53:46.560607 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea69ac84-ed7b-44d8-aad1-f5103b28eb13 None None] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:53:46.560607 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea69ac84-ed7b-44d8-aad1-f5103b28eb13 None None] PATH_INFO: `/` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:53:46.562295 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 726/1423] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 26 14:53:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:53:46.568607 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80db573-cc80-4aec-bc08-91a7b1f05883 None None] REQUEST_METHOD: `POST` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:53:46.568941 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80db573-cc80-4aec-bc08-91a7b1f05883 None None] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:53:46.569328 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80db573-cc80-4aec-bc08-91a7b1f05883 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:53:46.592147 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:53:46.661939 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.auth.core [None req-a80db573-cc80-4aec-bc08-91a7b1f05883 None None] MFA Rules not processed for user `e5ef88cc058f425b882bcb87a1e1e75c`. Rule list: `[]` (Enabled: `True`). {{(pid=87055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:53:46.663302 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.fernet_utils [None req-a80db573-cc80-4aec-bc08-91a7b1f05883 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:53:46.807009 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 698/1424] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 26 14:53:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 14:53:46.964421 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea69ac84-ed7b-44d8-aad1-f5103b28eb13 None None] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:53:46.966532 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.fernet_utils [None req-ea69ac84-ed7b-44d8-aad1-f5103b28eb13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:53:47.109229 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:53:47.160144 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea69ac84-ed7b-44d8-aad1-f5103b28eb13 None None] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:53:47.316275 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0556914-0ea3-4b43-ac98-5e32a3269abd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e86fe36c9bf49a481c9f15ac7571b88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c422a2290a14424da20e2841cbc1741d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:53:47.316911 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0556914-0ea3-4b43-ac98-5e32a3269abd service nova] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:53:47.317194 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0556914-0ea3-4b43-ac98-5e32a3269abd service nova] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:53:47.317465 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0556914-0ea3-4b43-ac98-5e32a3269abd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:53:47.319274 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.fernet_utils [None req-f0556914-0ea3-4b43-ac98-5e32a3269abd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:53:47.416190 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:53:47.434334 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0556914-0ea3-4b43-ac98-5e32a3269abd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:53:47.435965 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0556914-0ea3-4b43-ac98-5e32a3269abd service nova] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:53:47.459683 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 727/1425] 10.222.0.93 () {60 vars in 1365 bytes} [Tue Jul 26 14:53:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 496 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 14:53:48.446069 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3812689f-b194-45da-8ce9-f4dab073bb45 None None] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:53:48.446697 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3812689f-b194-45da-8ce9-f4dab073bb45 None None] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:53:48.446791 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3812689f-b194-45da-8ce9-f4dab073bb45 None None] PATH_INFO: `/` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:53:48.448867 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 699/1426] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 26 14:53:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 14:53:48.455558 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fcae1e-9c0b-4c82-8749-ff5c5c3d79d9 None None] REQUEST_METHOD: `POST` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:53:48.456112 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fcae1e-9c0b-4c82-8749-ff5c5c3d79d9 None None] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:53:48.456289 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fcae1e-9c0b-4c82-8749-ff5c5c3d79d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:53:48.559570 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.auth.core [None req-e4fcae1e-9c0b-4c82-8749-ff5c5c3d79d9 None None] MFA Rules not processed for user `e5ef88cc058f425b882bcb87a1e1e75c`. Rule list: `[]` (Enabled: `True`). {{(pid=87056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:53:48.561736 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.fernet_utils [None req-e4fcae1e-9c0b-4c82-8749-ff5c5c3d79d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:53:48.730528 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 728/1427] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 26 14:53:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 14:53:48.974833 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3812689f-b194-45da-8ce9-f4dab073bb45 None None] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:53:48.976531 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.fernet_utils [None req-3812689f-b194-45da-8ce9-f4dab073bb45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:53:49.075053 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:53:49.151561 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3812689f-b194-45da-8ce9-f4dab073bb45 None None] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:53:49.298199 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4e9cd6-5c8a-49a8-8dfe-2f7d5f48feaf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e86fe36c9bf49a481c9f15ac7571b88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c422a2290a14424da20e2841cbc1741d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:53:49.298819 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4e9cd6-5c8a-49a8-8dfe-2f7d5f48feaf service nova] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:53:49.299097 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4e9cd6-5c8a-49a8-8dfe-2f7d5f48feaf service nova] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:53:49.299370 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4e9cd6-5c8a-49a8-8dfe-2f7d5f48feaf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:53:49.301123 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.fernet_utils [None req-1f4e9cd6-5c8a-49a8-8dfe-2f7d5f48feaf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:53:49.359997 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:53:49.429145 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4e9cd6-5c8a-49a8-8dfe-2f7d5f48feaf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:53:49.432204 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4e9cd6-5c8a-49a8-8dfe-2f7d5f48feaf service nova] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:53:49.467822 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 700/1428] 10.222.0.93 () {60 vars in 1365 bytes} [Tue Jul 26 14:53:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 494 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 14:53:50.429669 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845dc4b6-edeb-4aa9-a7bb-629f1ceb6ced None None] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:53:50.430412 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845dc4b6-edeb-4aa9-a7bb-629f1ceb6ced None None] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:53:50.430412 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845dc4b6-edeb-4aa9-a7bb-629f1ceb6ced None None] PATH_INFO: `/` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:53:50.431657 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 729/1429] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 26 14:53:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 14:53:50.438394 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa37c3af-787d-445a-960c-cf65ee5d1d8b None None] REQUEST_METHOD: `POST` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:53:50.438822 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa37c3af-787d-445a-960c-cf65ee5d1d8b None None] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:53:50.439418 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa37c3af-787d-445a-960c-cf65ee5d1d8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:53:50.569862 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.auth.core [None req-aa37c3af-787d-445a-960c-cf65ee5d1d8b None None] MFA Rules not processed for user `e5ef88cc058f425b882bcb87a1e1e75c`. Rule list: `[]` (Enabled: `True`). {{(pid=87055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:53:50.571302 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.fernet_utils [None req-aa37c3af-787d-445a-960c-cf65ee5d1d8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:53:50.691833 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 701/1430] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 26 14:53:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 14:53:50.851176 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845dc4b6-edeb-4aa9-a7bb-629f1ceb6ced None None] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:53:50.852809 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.fernet_utils [None req-845dc4b6-edeb-4aa9-a7bb-629f1ceb6ced None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:53:50.923091 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:53:51.051480 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845dc4b6-edeb-4aa9-a7bb-629f1ceb6ced None None] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:53:51.183970 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e0501a-2a11-4aab-98f8-f1040da618a7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e86fe36c9bf49a481c9f15ac7571b88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c422a2290a14424da20e2841cbc1741d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:53:51.184607 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e0501a-2a11-4aab-98f8-f1040da618a7 service nova] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:53:51.184888 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e0501a-2a11-4aab-98f8-f1040da618a7 service nova] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:53:51.185166 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e0501a-2a11-4aab-98f8-f1040da618a7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:53:51.186911 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.fernet_utils [None req-33e0501a-2a11-4aab-98f8-f1040da618a7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:53:51.196164 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:53:51.310297 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e0501a-2a11-4aab-98f8-f1040da618a7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:53:51.311856 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e0501a-2a11-4aab-98f8-f1040da618a7 service nova] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:53:51.335290 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 730/1431] 10.222.0.93 () {60 vars in 1365 bytes} [Tue Jul 26 14:53:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 485 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 14:53:52.251746 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02148a99-4816-4332-998f-01fe12cbc9bf None None] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:53:52.252641 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02148a99-4816-4332-998f-01fe12cbc9bf None None] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:53:52.252824 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02148a99-4816-4332-998f-01fe12cbc9bf None None] PATH_INFO: `/` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:53:52.254453 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 702/1432] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 26 14:53:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:53:52.260379 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea014265-c28e-4a72-a437-50e507a784ce None None] REQUEST_METHOD: `POST` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:53:52.261045 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea014265-c28e-4a72-a437-50e507a784ce None None] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:53:52.261220 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea014265-c28e-4a72-a437-50e507a784ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:53:52.372647 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.auth.core [None req-ea014265-c28e-4a72-a437-50e507a784ce None None] MFA Rules not processed for user `e5ef88cc058f425b882bcb87a1e1e75c`. Rule list: `[]` (Enabled: `True`). {{(pid=87056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:53:52.374523 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.fernet_utils [None req-ea014265-c28e-4a72-a437-50e507a784ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:53:52.502756 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:53:52.558810 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 731/1433] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 26 14:53:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 14:53:52.719955 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02148a99-4816-4332-998f-01fe12cbc9bf None None] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:53:52.721709 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.fernet_utils [None req-02148a99-4816-4332-998f-01fe12cbc9bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:53:52.742497 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:53:52.913325 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02148a99-4816-4332-998f-01fe12cbc9bf None None] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:53:53.022655 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:53:53.058222 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c73822-2b71-4357-9313-490730f265f1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e86fe36c9bf49a481c9f15ac7571b88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c422a2290a14424da20e2841cbc1741d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:53:53.058887 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c73822-2b71-4357-9313-490730f265f1 service nova] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:53:53.059165 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c73822-2b71-4357-9313-490730f265f1 service nova] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:53:53.059437 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c73822-2b71-4357-9313-490730f265f1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:53:53.061234 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.fernet_utils [None req-f8c73822-2b71-4357-9313-490730f265f1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:53:53.187643 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c73822-2b71-4357-9313-490730f265f1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:53:53.191184 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c73822-2b71-4357-9313-490730f265f1 service nova] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:53:53.218599 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 703/1434] 10.222.0.93 () {60 vars in 1365 bytes} [Tue Jul 26 14:53:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 500 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 14:53:54.206871 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddebd03-9b84-4757-81f7-aabd9c75c913 None None] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:53:54.207606 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddebd03-9b84-4757-81f7-aabd9c75c913 None None] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:53:54.207606 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddebd03-9b84-4757-81f7-aabd9c75c913 None None] PATH_INFO: `/` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:53:54.209068 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 732/1435] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 26 14:53:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:53:54.215782 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444d9f83-a02a-4b2e-81b7-86a01510dfa2 None None] REQUEST_METHOD: `POST` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:53:54.216417 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444d9f83-a02a-4b2e-81b7-86a01510dfa2 None None] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:53:54.216551 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444d9f83-a02a-4b2e-81b7-86a01510dfa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:53:54.318067 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.auth.core [None req-444d9f83-a02a-4b2e-81b7-86a01510dfa2 None None] MFA Rules not processed for user `e5ef88cc058f425b882bcb87a1e1e75c`. Rule list: `[]` (Enabled: `True`). {{(pid=87055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:53:54.319741 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.fernet_utils [None req-444d9f83-a02a-4b2e-81b7-86a01510dfa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:53:54.373413 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:53:54.440699 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 704/1436] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 26 14:53:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 14:53:54.606287 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddebd03-9b84-4757-81f7-aabd9c75c913 None None] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:53:54.608089 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.fernet_utils [None req-3ddebd03-9b84-4757-81f7-aabd9c75c913 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:53:54.808611 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddebd03-9b84-4757-81f7-aabd9c75c913 None None] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:53:54.880641 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:53:54.974418 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b81db3-90bc-446d-83d3-fac9473bb0df service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e86fe36c9bf49a481c9f15ac7571b88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c422a2290a14424da20e2841cbc1741d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:53:54.974974 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b81db3-90bc-446d-83d3-fac9473bb0df service nova] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:53:54.975254 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b81db3-90bc-446d-83d3-fac9473bb0df service nova] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:53:54.975531 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b81db3-90bc-446d-83d3-fac9473bb0df service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:53:54.977235 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.fernet_utils [None req-06b81db3-90bc-446d-83d3-fac9473bb0df service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:53:55.100224 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b81db3-90bc-446d-83d3-fac9473bb0df service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:53:55.102040 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b81db3-90bc-446d-83d3-fac9473bb0df service nova] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:53:55.126165 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 733/1437] 10.222.0.93 () {60 vars in 1365 bytes} [Tue Jul 26 14:53:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 520 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 14:53:56.115223 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62b46a0-8b31-40cc-a590-13f2ae0cd7d9 None None] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:53:56.115973 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62b46a0-8b31-40cc-a590-13f2ae0cd7d9 None None] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:53:56.115973 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62b46a0-8b31-40cc-a590-13f2ae0cd7d9 None None] PATH_INFO: `/` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:53:56.117197 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 705/1438] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 26 14:53:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:53:56.122958 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43da06f1-ec80-4988-b0c9-6d8c29e07e7a None None] REQUEST_METHOD: `POST` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:53:56.123855 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43da06f1-ec80-4988-b0c9-6d8c29e07e7a None None] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:53:56.123855 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43da06f1-ec80-4988-b0c9-6d8c29e07e7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:53:56.223383 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.auth.core [None req-43da06f1-ec80-4988-b0c9-6d8c29e07e7a None None] MFA Rules not processed for user `e5ef88cc058f425b882bcb87a1e1e75c`. Rule list: `[]` (Enabled: `True`). {{(pid=87056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:53:56.224638 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.fernet_utils [None req-43da06f1-ec80-4988-b0c9-6d8c29e07e7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:53:56.227204 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:53:56.349558 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 734/1439] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 26 14:53:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 14:53:56.508527 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62b46a0-8b31-40cc-a590-13f2ae0cd7d9 None None] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:53:56.510452 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.fernet_utils [None req-b62b46a0-8b31-40cc-a590-13f2ae0cd7d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:53:56.739772 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62b46a0-8b31-40cc-a590-13f2ae0cd7d9 None None] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:53:56.775623 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:53:56.884586 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a06ade6-b317-4b9e-8653-9a7ef777c8a6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e86fe36c9bf49a481c9f15ac7571b88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c422a2290a14424da20e2841cbc1741d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:53:56.885218 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a06ade6-b317-4b9e-8653-9a7ef777c8a6 service nova] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:53:56.885499 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a06ade6-b317-4b9e-8653-9a7ef777c8a6 service nova] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:53:56.885792 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a06ade6-b317-4b9e-8653-9a7ef777c8a6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:53:56.888281 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.fernet_utils [None req-2a06ade6-b317-4b9e-8653-9a7ef777c8a6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:53:57.003685 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a06ade6-b317-4b9e-8653-9a7ef777c8a6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:53:57.005291 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a06ade6-b317-4b9e-8653-9a7ef777c8a6 service nova] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:53:57.027658 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 706/1440] 10.222.0.93 () {60 vars in 1365 bytes} [Tue Jul 26 14:53:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 520 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 14:53:59.056326 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63168c9d-c55e-4da1-bda8-23a64c5c594e None None] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:53:59.056882 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63168c9d-c55e-4da1-bda8-23a64c5c594e None None] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:53:59.056882 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63168c9d-c55e-4da1-bda8-23a64c5c594e None None] PATH_INFO: `/` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:53:59.058226 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 735/1441] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 26 14:53:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:53:59.064995 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c196cbd-0ecf-48e7-b255-078afad23a73 None None] REQUEST_METHOD: `POST` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:53:59.065561 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c196cbd-0ecf-48e7-b255-078afad23a73 None None] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:53:59.065561 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c196cbd-0ecf-48e7-b255-078afad23a73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:53:59.117590 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:53:59.149924 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.auth.core [None req-3c196cbd-0ecf-48e7-b255-078afad23a73 None None] MFA Rules not processed for user `e5ef88cc058f425b882bcb87a1e1e75c`. Rule list: `[]` (Enabled: `True`). {{(pid=87055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:53:59.151225 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.fernet_utils [None req-3c196cbd-0ecf-48e7-b255-078afad23a73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:53:59.281877 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 707/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 26 14:53:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 14:53:59.329772 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63168c9d-c55e-4da1-bda8-23a64c5c594e None None] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:53:59.332551 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.fernet_utils [None req-63168c9d-c55e-4da1-bda8-23a64c5c594e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:53:59.491363 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63168c9d-c55e-4da1-bda8-23a64c5c594e None None] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:53:59.532374 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:53:59.582760 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3750a287-2647-44aa-aa69-e15800f5366b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '541dcf2b85a145e99c7d0663a0ac0918', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c422a2290a14424da20e2841cbc1741d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:53:59.583279 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3750a287-2647-44aa-aa69-e15800f5366b service neutron] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:53:59.583565 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3750a287-2647-44aa-aa69-e15800f5366b service neutron] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:53:59.583846 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3750a287-2647-44aa-aa69-e15800f5366b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:53:59.585571 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.fernet_utils [None req-3750a287-2647-44aa-aa69-e15800f5366b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:53:59.736461 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3750a287-2647-44aa-aa69-e15800f5366b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:53:59.738111 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3750a287-2647-44aa-aa69-e15800f5366b service neutron] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:53:59.762935 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 736/1443] 10.222.0.93 () {60 vars in 1365 bytes} [Tue Jul 26 14:53:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 14:54:02.245871 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31aff7e5-eb2a-4cf8-8bfc-972fcee73d98 None None] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:54:02.246538 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31aff7e5-eb2a-4cf8-8bfc-972fcee73d98 None None] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:54:02.246538 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31aff7e5-eb2a-4cf8-8bfc-972fcee73d98 None None] PATH_INFO: `/` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:54:02.247891 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 708/1444] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 26 14:54:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:54:02.258394 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633eccbe-8aab-4504-b7b6-167156cb1273 None None] REQUEST_METHOD: `POST` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:54:02.258983 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633eccbe-8aab-4504-b7b6-167156cb1273 None None] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:54:02.259351 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633eccbe-8aab-4504-b7b6-167156cb1273 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:54:02.365991 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.auth.core [None req-633eccbe-8aab-4504-b7b6-167156cb1273 None None] MFA Rules not processed for user `e5ef88cc058f425b882bcb87a1e1e75c`. Rule list: `[]` (Enabled: `True`). {{(pid=87056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:54:02.368143 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.fernet_utils [None req-633eccbe-8aab-4504-b7b6-167156cb1273 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:54:02.394115 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:54:02.549267 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 737/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 26 14:54:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 14:54:02.592571 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31aff7e5-eb2a-4cf8-8bfc-972fcee73d98 None None] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:54:02.595699 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.fernet_utils [None req-31aff7e5-eb2a-4cf8-8bfc-972fcee73d98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:54:02.744306 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31aff7e5-eb2a-4cf8-8bfc-972fcee73d98 None None] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:54:02.768904 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:54:02.868429 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038f3cbf-6780-4f45-be96-9f275cf8ba5c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '541dcf2b85a145e99c7d0663a0ac0918', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c422a2290a14424da20e2841cbc1741d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:54:02.868871 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038f3cbf-6780-4f45-be96-9f275cf8ba5c service neutron] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:54:02.869154 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038f3cbf-6780-4f45-be96-9f275cf8ba5c service neutron] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:54:02.869434 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038f3cbf-6780-4f45-be96-9f275cf8ba5c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:54:02.871241 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.fernet_utils [None req-038f3cbf-6780-4f45-be96-9f275cf8ba5c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:54:03.005801 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038f3cbf-6780-4f45-be96-9f275cf8ba5c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:54:03.007303 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038f3cbf-6780-4f45-be96-9f275cf8ba5c service neutron] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:54:03.034268 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 709/1446] 10.222.0.93 () {60 vars in 1365 bytes} [Tue Jul 26 14:54:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 14:54:06.184731 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753f5aa7-54b0-4794-af0c-1dd215534ad0 None None] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:54:06.185623 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753f5aa7-54b0-4794-af0c-1dd215534ad0 None None] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:54:06.185804 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753f5aa7-54b0-4794-af0c-1dd215534ad0 None None] PATH_INFO: `/` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:54:06.187351 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 738/1447] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 26 14:54:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:54:06.193647 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61067a5-dc9a-4397-ab9e-5f78dabb632d None None] REQUEST_METHOD: `POST` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:54:06.194213 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61067a5-dc9a-4397-ab9e-5f78dabb632d None None] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:54:06.194357 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61067a5-dc9a-4397-ab9e-5f78dabb632d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:54:06.253253 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:54:06.275761 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.auth.core [None req-a61067a5-dc9a-4397-ab9e-5f78dabb632d None None] MFA Rules not processed for user `e5ef88cc058f425b882bcb87a1e1e75c`. Rule list: `[]` (Enabled: `True`). {{(pid=87055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:54:06.277239 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.fernet_utils [None req-a61067a5-dc9a-4397-ab9e-5f78dabb632d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:54:06.393784 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 710/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 26 14:54:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 14:54:06.436152 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753f5aa7-54b0-4794-af0c-1dd215534ad0 None None] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:54:06.438402 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.fernet_utils [None req-753f5aa7-54b0-4794-af0c-1dd215534ad0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:54:06.561637 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753f5aa7-54b0-4794-af0c-1dd215534ad0 None None] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:54:06.612023 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:54:06.652284 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5904e9d6-c7a7-4135-9c49-41f01b7c7404 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '541dcf2b85a145e99c7d0663a0ac0918', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c422a2290a14424da20e2841cbc1741d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:54:06.653496 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5904e9d6-c7a7-4135-9c49-41f01b7c7404 service neutron] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:54:06.654094 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5904e9d6-c7a7-4135-9c49-41f01b7c7404 service neutron] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:54:06.654558 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5904e9d6-c7a7-4135-9c49-41f01b7c7404 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:54:06.658405 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.fernet_utils [None req-5904e9d6-c7a7-4135-9c49-41f01b7c7404 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:54:06.793993 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5904e9d6-c7a7-4135-9c49-41f01b7c7404 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:54:06.795604 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5904e9d6-c7a7-4135-9c49-41f01b7c7404 service neutron] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:54:06.819275 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 739/1449] 10.222.0.93 () {60 vars in 1365 bytes} [Tue Jul 26 14:54:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 14:54:09.228546 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1edd5f-8b0e-4236-acc1-4105e7307914 None None] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:54:09.229357 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1edd5f-8b0e-4236-acc1-4105e7307914 None None] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:54:09.229468 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1edd5f-8b0e-4236-acc1-4105e7307914 None None] PATH_INFO: `/` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:54:09.232087 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 711/1450] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 26 14:54:09 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:54:09.239918 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5d8720-79e6-4949-955d-bfa626a62b56 None None] REQUEST_METHOD: `POST` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:54:09.240531 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5d8720-79e6-4949-955d-bfa626a62b56 None None] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:54:09.240531 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5d8720-79e6-4949-955d-bfa626a62b56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:54:09.324684 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.auth.core [None req-5a5d8720-79e6-4949-955d-bfa626a62b56 None None] MFA Rules not processed for user `e5ef88cc058f425b882bcb87a1e1e75c`. Rule list: `[]` (Enabled: `True`). {{(pid=87056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:54:09.325829 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.fernet_utils [None req-5a5d8720-79e6-4949-955d-bfa626a62b56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:54:09.355466 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:54:09.487594 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 740/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 26 14:54:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 14:54:09.530164 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1edd5f-8b0e-4236-acc1-4105e7307914 None None] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:54:09.533709 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.fernet_utils [None req-1a1edd5f-8b0e-4236-acc1-4105e7307914 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:54:09.703415 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1edd5f-8b0e-4236-acc1-4105e7307914 None None] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:54:09.727934 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:54:09.797151 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d8acb2-e76e-4c0c-9d58-3094e239f6a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '541dcf2b85a145e99c7d0663a0ac0918', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c422a2290a14424da20e2841cbc1741d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:54:09.798227 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d8acb2-e76e-4c0c-9d58-3094e239f6a3 service neutron] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:54:09.798393 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d8acb2-e76e-4c0c-9d58-3094e239f6a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:54:09.798698 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d8acb2-e76e-4c0c-9d58-3094e239f6a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:54:09.800648 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.fernet_utils [None req-a6d8acb2-e76e-4c0c-9d58-3094e239f6a3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:54:09.981704 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d8acb2-e76e-4c0c-9d58-3094e239f6a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:54:09.985141 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d8acb2-e76e-4c0c-9d58-3094e239f6a3 service neutron] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:54:10.021504 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 712/1452] 10.222.0.93 () {60 vars in 1365 bytes} [Tue Jul 26 14:54:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 493 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 14:54:12.317213 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eea3c10-fd75-4d50-b169-e8844c21d0d2 None None] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:54:12.317816 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eea3c10-fd75-4d50-b169-e8844c21d0d2 None None] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:54:12.318197 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eea3c10-fd75-4d50-b169-e8844c21d0d2 None None] PATH_INFO: `/` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:54:12.320883 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 741/1453] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 26 14:54:12 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:54:12.327025 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9d7956-0940-47b9-80fe-3604539f3d0f None None] REQUEST_METHOD: `POST` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:54:12.327564 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9d7956-0940-47b9-80fe-3604539f3d0f None None] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:54:12.327722 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9d7956-0940-47b9-80fe-3604539f3d0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:54:12.408670 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:54:12.412323 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.auth.core [None req-bd9d7956-0940-47b9-80fe-3604539f3d0f None None] MFA Rules not processed for user `e5ef88cc058f425b882bcb87a1e1e75c`. Rule list: `[]` (Enabled: `True`). {{(pid=87055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:54:12.413950 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.fernet_utils [None req-bd9d7956-0940-47b9-80fe-3604539f3d0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:54:12.536095 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 713/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 26 14:54:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 14:54:12.578597 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eea3c10-fd75-4d50-b169-e8844c21d0d2 None None] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:54:12.580395 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.fernet_utils [None req-1eea3c10-fd75-4d50-b169-e8844c21d0d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:54:12.711299 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eea3c10-fd75-4d50-b169-e8844c21d0d2 None None] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:54:12.773925 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:54:12.806208 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee5f477-f251-4c97-9302-8b77219e51e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '541dcf2b85a145e99c7d0663a0ac0918', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c422a2290a14424da20e2841cbc1741d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:54:12.807308 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee5f477-f251-4c97-9302-8b77219e51e6 service neutron] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:54:12.807913 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee5f477-f251-4c97-9302-8b77219e51e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:54:12.808286 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee5f477-f251-4c97-9302-8b77219e51e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:54:12.810151 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.fernet_utils [None req-5ee5f477-f251-4c97-9302-8b77219e51e6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:54:12.959163 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee5f477-f251-4c97-9302-8b77219e51e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:54:12.960783 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee5f477-f251-4c97-9302-8b77219e51e6 service neutron] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:54:12.985620 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 742/1455] 10.222.0.93 () {60 vars in 1365 bytes} [Tue Jul 26 14:54:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 14:54:15.485386 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1504323-b0ee-4d7e-bb5a-e4de34504af5 None None] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:54:15.486283 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1504323-b0ee-4d7e-bb5a-e4de34504af5 None None] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:54:15.486283 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1504323-b0ee-4d7e-bb5a-e4de34504af5 None None] PATH_INFO: `/` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:54:15.487404 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 714/1456] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 26 14:54:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:54:15.493656 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7029e1aa-7fd6-4070-9846-2a702afdda97 None None] REQUEST_METHOD: `POST` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:54:15.494370 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7029e1aa-7fd6-4070-9846-2a702afdda97 None None] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:54:15.494370 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7029e1aa-7fd6-4070-9846-2a702afdda97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:54:15.592551 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.auth.core [None req-7029e1aa-7fd6-4070-9846-2a702afdda97 None None] MFA Rules not processed for user `e5ef88cc058f425b882bcb87a1e1e75c`. Rule list: `[]` (Enabled: `True`). {{(pid=87056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:54:15.595255 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.fernet_utils [None req-7029e1aa-7fd6-4070-9846-2a702afdda97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:54:15.636958 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:54:15.744678 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 743/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 26 14:54:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 14:54:15.788307 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1504323-b0ee-4d7e-bb5a-e4de34504af5 None None] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:54:15.790278 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.fernet_utils [None req-e1504323-b0ee-4d7e-bb5a-e4de34504af5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:54:15.933184 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1504323-b0ee-4d7e-bb5a-e4de34504af5 None None] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:54:15.971494 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:54:16.037721 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327f9241-47e7-412a-acb0-d1a8d13dda0a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '541dcf2b85a145e99c7d0663a0ac0918', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c422a2290a14424da20e2841cbc1741d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:54:16.038328 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327f9241-47e7-412a-acb0-d1a8d13dda0a service neutron] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:54:16.038726 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327f9241-47e7-412a-acb0-d1a8d13dda0a service neutron] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:54:16.039102 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327f9241-47e7-412a-acb0-d1a8d13dda0a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:54:16.040984 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.fernet_utils [None req-327f9241-47e7-412a-acb0-d1a8d13dda0a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:54:16.181807 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327f9241-47e7-412a-acb0-d1a8d13dda0a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:54:16.183420 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327f9241-47e7-412a-acb0-d1a8d13dda0a service neutron] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:54:16.210924 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 715/1458] 10.222.0.93 () {60 vars in 1365 bytes} [Tue Jul 26 14:54:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 14:54:19.080396 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05231c28-2ace-4dd2-95aa-b875d90693e2 None None] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:54:19.080979 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05231c28-2ace-4dd2-95aa-b875d90693e2 None None] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:54:19.080979 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05231c28-2ace-4dd2-95aa-b875d90693e2 None None] PATH_INFO: `/` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:54:19.082640 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 744/1459] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 26 14:54:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:54:19.089057 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9e79ea-51b1-4268-9b1d-eae1f5a3a80c None None] REQUEST_METHOD: `POST` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:54:19.094570 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9e79ea-51b1-4268-9b1d-eae1f5a3a80c None None] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:54:19.094570 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9e79ea-51b1-4268-9b1d-eae1f5a3a80c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:54:19.196663 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.auth.core [None req-4e9e79ea-51b1-4268-9b1d-eae1f5a3a80c None None] MFA Rules not processed for user `e5ef88cc058f425b882bcb87a1e1e75c`. Rule list: `[]` (Enabled: `True`). {{(pid=87055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:54:19.198784 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.fernet_utils [None req-4e9e79ea-51b1-4268-9b1d-eae1f5a3a80c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:54:19.216064 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:54:19.389490 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 716/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 26 14:54:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 14:54:19.431426 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05231c28-2ace-4dd2-95aa-b875d90693e2 None None] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:54:19.433047 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.fernet_utils [None req-05231c28-2ace-4dd2-95aa-b875d90693e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:54:19.557955 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05231c28-2ace-4dd2-95aa-b875d90693e2 None None] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:54:19.632496 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:54:19.661252 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13220a5e-6cde-49d5-8906-4a884f61c054 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '541dcf2b85a145e99c7d0663a0ac0918', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c422a2290a14424da20e2841cbc1741d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:54:19.661804 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13220a5e-6cde-49d5-8906-4a884f61c054 service neutron] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:54:19.662084 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13220a5e-6cde-49d5-8906-4a884f61c054 service neutron] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:54:19.662399 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13220a5e-6cde-49d5-8906-4a884f61c054 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:54:19.664117 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.fernet_utils [None req-13220a5e-6cde-49d5-8906-4a884f61c054 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:54:19.801236 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13220a5e-6cde-49d5-8906-4a884f61c054 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:54:19.802862 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13220a5e-6cde-49d5-8906-4a884f61c054 service neutron] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:54:19.825417 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 745/1461] 10.222.0.93 () {60 vars in 1365 bytes} [Tue Jul 26 14:54:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 14:54:22.110119 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de154925-bc53-4e5f-843f-ff68d6909c74 None None] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:54:22.110847 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de154925-bc53-4e5f-843f-ff68d6909c74 None None] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:54:22.110847 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de154925-bc53-4e5f-843f-ff68d6909c74 None None] PATH_INFO: `/` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:54:22.112327 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 717/1462] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 26 14:54:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 14:54:22.119737 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dff6266-928d-4667-be59-47a8e7abba49 None None] REQUEST_METHOD: `POST` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:54:22.120344 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dff6266-928d-4667-be59-47a8e7abba49 None None] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:54:22.120723 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dff6266-928d-4667-be59-47a8e7abba49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:54:22.228151 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.auth.core [None req-6dff6266-928d-4667-be59-47a8e7abba49 None None] MFA Rules not processed for user `e5ef88cc058f425b882bcb87a1e1e75c`. Rule list: `[]` (Enabled: `True`). {{(pid=87056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:54:22.229430 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.fernet_utils [None req-6dff6266-928d-4667-be59-47a8e7abba49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:54:22.279127 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:54:22.355932 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 746/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 26 14:54:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 14:54:22.398726 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de154925-bc53-4e5f-843f-ff68d6909c74 None None] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:54:22.400338 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.fernet_utils [None req-de154925-bc53-4e5f-843f-ff68d6909c74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:54:22.526206 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de154925-bc53-4e5f-843f-ff68d6909c74 None None] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:54:22.573686 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:54:22.617874 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58ed642-bf41-4ce4-a23a-d93662424d42 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '541dcf2b85a145e99c7d0663a0ac0918', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c422a2290a14424da20e2841cbc1741d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:54:22.618661 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58ed642-bf41-4ce4-a23a-d93662424d42 service neutron] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:54:22.619547 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58ed642-bf41-4ce4-a23a-d93662424d42 service neutron] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:54:22.619826 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58ed642-bf41-4ce4-a23a-d93662424d42 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:54:22.621591 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.fernet_utils [None req-a58ed642-bf41-4ce4-a23a-d93662424d42 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:54:22.757082 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58ed642-bf41-4ce4-a23a-d93662424d42 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:54:22.758580 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58ed642-bf41-4ce4-a23a-d93662424d42 service neutron] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:54:22.781957 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 718/1464] 10.222.0.93 () {60 vars in 1365 bytes} [Tue Jul 26 14:54:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 14:54:25.089428 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1801351-dbc6-4472-8b46-2cfbd15a94e5 None None] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:54:25.090218 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1801351-dbc6-4472-8b46-2cfbd15a94e5 None None] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:54:25.090218 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1801351-dbc6-4472-8b46-2cfbd15a94e5 None None] PATH_INFO: `/` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:54:25.091587 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 747/1465] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 26 14:54:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 14:54:25.098545 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcd5149-a0c3-43bf-8d39-3f75a2aca005 None None] REQUEST_METHOD: `POST` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:54:25.099431 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcd5149-a0c3-43bf-8d39-3f75a2aca005 None None] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:54:25.099431 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcd5149-a0c3-43bf-8d39-3f75a2aca005 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:54:25.184914 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.auth.core [None req-5bcd5149-a0c3-43bf-8d39-3f75a2aca005 None None] MFA Rules not processed for user `e5ef88cc058f425b882bcb87a1e1e75c`. Rule list: `[]` (Enabled: `True`). {{(pid=87055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:54:25.186314 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.fernet_utils [None req-5bcd5149-a0c3-43bf-8d39-3f75a2aca005 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:54:25.210648 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:54:25.319677 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 719/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 26 14:54:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 14:54:25.361411 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1801351-dbc6-4472-8b46-2cfbd15a94e5 None None] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:54:25.364373 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.fernet_utils [None req-b1801351-dbc6-4472-8b46-2cfbd15a94e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:54:25.525267 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1801351-dbc6-4472-8b46-2cfbd15a94e5 None None] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:54:25.617680 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:54:25.627238 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc26b6ea-2f0c-4c06-9d63-adb8237ada92 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '541dcf2b85a145e99c7d0663a0ac0918', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c422a2290a14424da20e2841cbc1741d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:54:25.628046 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc26b6ea-2f0c-4c06-9d63-adb8237ada92 service neutron] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:54:25.628373 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc26b6ea-2f0c-4c06-9d63-adb8237ada92 service neutron] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:54:25.628679 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc26b6ea-2f0c-4c06-9d63-adb8237ada92 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:54:25.630639 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.fernet_utils [None req-cc26b6ea-2f0c-4c06-9d63-adb8237ada92 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:54:25.831799 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc26b6ea-2f0c-4c06-9d63-adb8237ada92 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:54:25.834577 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc26b6ea-2f0c-4c06-9d63-adb8237ada92 service neutron] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:54:25.861949 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 748/1467] 10.222.0.93 () {60 vars in 1365 bytes} [Tue Jul 26 14:54:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 502 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 14:54:28.255173 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374f2e66-95e5-4c32-9edc-492cbc4866d6 None None] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:54:28.255981 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374f2e66-95e5-4c32-9edc-492cbc4866d6 None None] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:54:28.255981 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374f2e66-95e5-4c32-9edc-492cbc4866d6 None None] PATH_INFO: `/` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:54:28.257205 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 720/1468] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 26 14:54:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:54:28.263827 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042b3763-3b10-4388-92c1-8646d85450db None None] REQUEST_METHOD: `POST` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:54:28.264461 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042b3763-3b10-4388-92c1-8646d85450db None None] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:54:28.264461 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042b3763-3b10-4388-92c1-8646d85450db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:54:28.353016 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.auth.core [None req-042b3763-3b10-4388-92c1-8646d85450db None None] MFA Rules not processed for user `e5ef88cc058f425b882bcb87a1e1e75c`. Rule list: `[]` (Enabled: `True`). {{(pid=87056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:54:28.354317 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.fernet_utils [None req-042b3763-3b10-4388-92c1-8646d85450db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:54:28.419056 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:54:28.493848 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 749/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 26 14:54:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 14:54:28.534612 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374f2e66-95e5-4c32-9edc-492cbc4866d6 None None] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:54:28.536208 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.fernet_utils [None req-374f2e66-95e5-4c32-9edc-492cbc4866d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:54:28.667522 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374f2e66-95e5-4c32-9edc-492cbc4866d6 None None] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:54:28.746621 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:54:28.780766 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77744400-81bf-4008-b6ca-c73a4fdeba97 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '541dcf2b85a145e99c7d0663a0ac0918', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c422a2290a14424da20e2841cbc1741d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:54:28.781503 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77744400-81bf-4008-b6ca-c73a4fdeba97 service neutron] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:54:28.781835 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77744400-81bf-4008-b6ca-c73a4fdeba97 service neutron] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:54:28.782118 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77744400-81bf-4008-b6ca-c73a4fdeba97 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:54:28.783915 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.fernet_utils [None req-77744400-81bf-4008-b6ca-c73a4fdeba97 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:54:28.920764 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77744400-81bf-4008-b6ca-c73a4fdeba97 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:54:28.922309 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77744400-81bf-4008-b6ca-c73a4fdeba97 service neutron] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:54:28.945301 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 721/1470] 10.222.0.93 () {60 vars in 1365 bytes} [Tue Jul 26 14:54:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 14:54:38.489931 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=22 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:54:38.942654 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=66 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:54:52.997533 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97179ca1-b53a-4c32-8661-40025fb661b1 None None] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:54:52.998760 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97179ca1-b53a-4c32-8661-40025fb661b1 None None] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:54:52.998760 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97179ca1-b53a-4c32-8661-40025fb661b1 None None] PATH_INFO: `/` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:54:53.000686 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 750/1471] 10.222.0.93 () {54 vars in 926 bytes} [Tue Jul 26 14:54:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 14:54:53.009997 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f2dd6d-fcc6-455d-81cf-dc45c4df3073 None None] REQUEST_METHOD: `POST` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:54:53.010659 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f2dd6d-fcc6-455d-81cf-dc45c4df3073 None None] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:54:53.011006 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f2dd6d-fcc6-455d-81cf-dc45c4df3073 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:54:53.143256 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.auth.core [None req-88f2dd6d-fcc6-455d-81cf-dc45c4df3073 None None] MFA Rules not processed for user `e5ef88cc058f425b882bcb87a1e1e75c`. Rule list: `[]` (Enabled: `True`). {{(pid=87055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:54:53.145433 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.fernet_utils [None req-88f2dd6d-fcc6-455d-81cf-dc45c4df3073 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:54:53.334479 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 722/1472] 10.222.0.93 () {58 vars in 1023 bytes} [Tue Jul 26 14:54:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 326 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 14:54:53.434901 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0d2dde-5926-41b1-b4f7-7aba0e76217c None None] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:54:53.435209 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0d2dde-5926-41b1-b4f7-7aba0e76217c None None] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:54:53.436313 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0d2dde-5926-41b1-b4f7-7aba0e76217c None None] PATH_INFO: `/` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:54:53.437856 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 751/1473] 10.222.0.93 () {54 vars in 966 bytes} [Tue Jul 26 14:54:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:54:53.443719 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3136c5e4-f061-4587-8186-c8020e064105 None None] REQUEST_METHOD: `POST` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:54:53.444047 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3136c5e4-f061-4587-8186-c8020e064105 None None] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:54:53.444276 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3136c5e4-f061-4587-8186-c8020e064105 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:54:53.541317 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.auth.core [None req-3136c5e4-f061-4587-8186-c8020e064105 None None] MFA Rules not processed for user `38ab40a64fb7419ebb0476e0fa09a2bb`. Rule list: `[]` (Enabled: `True`). {{(pid=87055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:54:53.542690 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.fernet_utils [None req-3136c5e4-f061-4587-8186-c8020e064105 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:54:53.570046 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:54:53.675734 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 723/1474] 10.222.0.93 () {58 vars in 1063 bytes} [Tue Jul 26 14:54:53 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 14:54:53.683869 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0d2dde-5926-41b1-b4f7-7aba0e76217c None None] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:54:53.686094 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.fernet_utils [None req-3f0d2dde-5926-41b1-b4f7-7aba0e76217c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:54:53.817748 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0d2dde-5926-41b1-b4f7-7aba0e76217c None None] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:54:53.912451 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccca2928-b58c-4752-b9d2-515d4bd6d05b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38ab40a64fb7419ebb0476e0fa09a2bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c422a2290a14424da20e2841cbc1741d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:54:53.913151 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccca2928-b58c-4752-b9d2-515d4bd6d05b service glance] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:54:53.913473 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccca2928-b58c-4752-b9d2-515d4bd6d05b service glance] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:54:53.913815 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccca2928-b58c-4752-b9d2-515d4bd6d05b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:54:53.915643 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.fernet_utils [None req-ccca2928-b58c-4752-b9d2-515d4bd6d05b service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:54:53.989482 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:54:54.081031 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccca2928-b58c-4752-b9d2-515d4bd6d05b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:54:54.082760 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccca2928-b58c-4752-b9d2-515d4bd6d05b service glance] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:54:54.112307 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 752/1475] 10.222.0.93 () {60 vars in 1365 bytes} [Tue Jul 26 14:54:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 14:54:56.566203 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1debd2a3-0b42-4d42-8044-c392ad900119 None None] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:54:56.566814 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1debd2a3-0b42-4d42-8044-c392ad900119 None None] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:54:56.566814 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1debd2a3-0b42-4d42-8044-c392ad900119 None None] PATH_INFO: `/` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:54:56.568323 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 724/1476] 10.222.0.93 () {54 vars in 926 bytes} [Tue Jul 26 14:54:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:54:56.574841 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16062782-bf13-4925-93ff-f78260f5afd1 None None] REQUEST_METHOD: `POST` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:54:56.575444 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16062782-bf13-4925-93ff-f78260f5afd1 None None] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:54:56.575730 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16062782-bf13-4925-93ff-f78260f5afd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:54:56.660880 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.auth.core [None req-16062782-bf13-4925-93ff-f78260f5afd1 None None] MFA Rules not processed for user `e5ef88cc058f425b882bcb87a1e1e75c`. Rule list: `[]` (Enabled: `True`). {{(pid=87056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:54:56.662140 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.fernet_utils [None req-16062782-bf13-4925-93ff-f78260f5afd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:54:56.824971 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 753/1477] 10.222.0.93 () {58 vars in 1023 bytes} [Tue Jul 26 14:54:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 14:54:56.849450 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1debd2a3-0b42-4d42-8044-c392ad900119 None None] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:54:56.851149 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.fernet_utils [None req-1debd2a3-0b42-4d42-8044-c392ad900119 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:54:57.011463 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1debd2a3-0b42-4d42-8044-c392ad900119 None None] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:54:57.073401 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:54:57.130301 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cb3ef4-be06-4aec-8594-e725d0f83ac2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f499667f2a194620a3504e461bf3cc25', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:54:57.130927 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cb3ef4-be06-4aec-8594-e725d0f83ac2 admin admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:54:57.131209 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cb3ef4-be06-4aec-8594-e725d0f83ac2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:54:57.131491 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cb3ef4-be06-4aec-8594-e725d0f83ac2 admin admin] PATH_INFO: `/v3/projects` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:54:57.132205 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cb3ef4-be06-4aec-8594-e725d0f83ac2 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:54:57.134317 dv-cinder-851030-1-smb devstack@keystone.service[87055]: WARNING py.warnings [None req-57cb3ef4-be06-4aec-8594-e725d0f83ac2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:54:57.134317 dv-cinder-851030-1-smb devstack@keystone.service[87055]: warnings.warn(msg) Jul 26 14:54:57.134317 dv-cinder-851030-1-smb devstack@keystone.service[87055]: Jul 26 14:54:57.135310 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cb3ef4-be06-4aec-8594-e725d0f83ac2 admin admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:54:57.159925 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 725/1478] 10.222.0.93 () {56 vars in 1108 bytes} [Tue Jul 26 14:54:56 2022] GET /identity/v3/projects => generated 2553 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 14:54:59.380118 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c46012f-4ac2-4e82-8383-d607f6a42452 None None] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:54:59.380735 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c46012f-4ac2-4e82-8383-d607f6a42452 None None] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:54:59.380885 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c46012f-4ac2-4e82-8383-d607f6a42452 None None] PATH_INFO: `/` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:54:59.382496 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 754/1479] 10.222.0.93 () {54 vars in 926 bytes} [Tue Jul 26 14:54:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:54:59.389034 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca448361-9d5d-4247-badf-bff50173af1f None None] REQUEST_METHOD: `POST` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:54:59.389613 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca448361-9d5d-4247-badf-bff50173af1f None None] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:54:59.389613 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca448361-9d5d-4247-badf-bff50173af1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:54:59.466330 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.auth.core [None req-ca448361-9d5d-4247-badf-bff50173af1f None None] MFA Rules not processed for user `e5ef88cc058f425b882bcb87a1e1e75c`. Rule list: `[]` (Enabled: `True`). {{(pid=87055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:54:59.467757 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.fernet_utils [None req-ca448361-9d5d-4247-badf-bff50173af1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:54:59.611621 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 726/1480] 10.222.0.93 () {58 vars in 1023 bytes} [Tue Jul 26 14:54:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 14:54:59.662486 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c46012f-4ac2-4e82-8383-d607f6a42452 None None] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:54:59.665474 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.fernet_utils [None req-5c46012f-4ac2-4e82-8383-d607f6a42452 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:54:59.678073 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:54:59.844830 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c46012f-4ac2-4e82-8383-d607f6a42452 None None] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:54:59.944259 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:54:59.997262 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3c07dc-2e31-447c-88e0-ad8d298d0a2d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e86fe36c9bf49a481c9f15ac7571b88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c422a2290a14424da20e2841cbc1741d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:54:59.998656 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3c07dc-2e31-447c-88e0-ad8d298d0a2d service nova] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:54:59.999375 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3c07dc-2e31-447c-88e0-ad8d298d0a2d service nova] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:54:59.999743 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3c07dc-2e31-447c-88e0-ad8d298d0a2d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:00.003698 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.fernet_utils [None req-7a3c07dc-2e31-447c-88e0-ad8d298d0a2d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:55:00.150336 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3c07dc-2e31-447c-88e0-ad8d298d0a2d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:55:00.152557 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3c07dc-2e31-447c-88e0-ad8d298d0a2d service nova] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:55:00.175398 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 755/1481] 10.222.0.93 () {60 vars in 1365 bytes} [Tue Jul 26 14:54:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 514 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 14:55:02.636385 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6776c8d-0cd1-4271-915e-4183317f2e26 None None] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:02.636990 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6776c8d-0cd1-4271-915e-4183317f2e26 None None] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:02.637430 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6776c8d-0cd1-4271-915e-4183317f2e26 None None] PATH_INFO: `/` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:02.641029 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 727/1482] 10.222.0.93 () {54 vars in 926 bytes} [Tue Jul 26 14:55:02 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:55:02.647628 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7336122-1cbf-492e-af24-bb89786e1c6e None None] REQUEST_METHOD: `POST` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:02.648237 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7336122-1cbf-492e-af24-bb89786e1c6e None None] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:02.648237 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7336122-1cbf-492e-af24-bb89786e1c6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:02.742754 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.auth.core [None req-f7336122-1cbf-492e-af24-bb89786e1c6e None None] MFA Rules not processed for user `e5ef88cc058f425b882bcb87a1e1e75c`. Rule list: `[]` (Enabled: `True`). {{(pid=87056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:55:02.744203 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.fernet_utils [None req-f7336122-1cbf-492e-af24-bb89786e1c6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:55:02.806213 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:55:02.865858 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 756/1483] 10.222.0.93 () {58 vars in 1023 bytes} [Tue Jul 26 14:55:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 14:55:02.904842 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6776c8d-0cd1-4271-915e-4183317f2e26 None None] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:55:02.906472 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.fernet_utils [None req-d6776c8d-0cd1-4271-915e-4183317f2e26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:55:02.933682 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:55:03.028264 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6776c8d-0cd1-4271-915e-4183317f2e26 None None] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:55:03.120850 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0579e338-f235-41ec-9e6b-86f4a29764b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '541dcf2b85a145e99c7d0663a0ac0918', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c422a2290a14424da20e2841cbc1741d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:55:03.121576 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0579e338-f235-41ec-9e6b-86f4a29764b0 service neutron] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:03.121970 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0579e338-f235-41ec-9e6b-86f4a29764b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:03.122326 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0579e338-f235-41ec-9e6b-86f4a29764b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:03.124482 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.fernet_utils [None req-0579e338-f235-41ec-9e6b-86f4a29764b0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:55:03.221341 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:55:03.262930 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0579e338-f235-41ec-9e6b-86f4a29764b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:55:03.264962 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0579e338-f235-41ec-9e6b-86f4a29764b0 service neutron] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:55:03.287859 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 728/1484] 10.222.0.93 () {60 vars in 1365 bytes} [Tue Jul 26 14:55:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 14:55:05.555093 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc3d374-3647-4ee8-87cf-b101fa62e334 None None] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:05.555923 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc3d374-3647-4ee8-87cf-b101fa62e334 None None] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:05.555923 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc3d374-3647-4ee8-87cf-b101fa62e334 None None] PATH_INFO: `/` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:05.557132 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 757/1485] 10.222.0.93 () {54 vars in 926 bytes} [Tue Jul 26 14:55:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 14:55:05.564799 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144449f1-11c5-44da-a378-6b542818d049 None None] REQUEST_METHOD: `POST` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:05.565551 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144449f1-11c5-44da-a378-6b542818d049 None None] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:05.565551 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144449f1-11c5-44da-a378-6b542818d049 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:05.652741 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.auth.core [None req-144449f1-11c5-44da-a378-6b542818d049 None None] MFA Rules not processed for user `e5ef88cc058f425b882bcb87a1e1e75c`. Rule list: `[]` (Enabled: `True`). {{(pid=87055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:55:05.654989 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.fernet_utils [None req-144449f1-11c5-44da-a378-6b542818d049 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:55:05.780972 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 729/1486] 10.222.0.93 () {58 vars in 1023 bytes} [Tue Jul 26 14:55:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 14:55:05.849519 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc3d374-3647-4ee8-87cf-b101fa62e334 None None] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:55:05.851318 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.fernet_utils [None req-adc3d374-3647-4ee8-87cf-b101fa62e334 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:55:05.976790 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc3d374-3647-4ee8-87cf-b101fa62e334 None None] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:55:06.072401 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:55:06.074537 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21259311-c0c6-4fe7-9a7f-e6097e4e365a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '541dcf2b85a145e99c7d0663a0ac0918', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c422a2290a14424da20e2841cbc1741d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:55:06.075332 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21259311-c0c6-4fe7-9a7f-e6097e4e365a service neutron] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:06.076529 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21259311-c0c6-4fe7-9a7f-e6097e4e365a service neutron] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:06.076914 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21259311-c0c6-4fe7-9a7f-e6097e4e365a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:06.079050 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.fernet_utils [None req-21259311-c0c6-4fe7-9a7f-e6097e4e365a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:55:06.217698 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21259311-c0c6-4fe7-9a7f-e6097e4e365a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:55:06.219222 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21259311-c0c6-4fe7-9a7f-e6097e4e365a service neutron] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:55:06.242108 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 758/1487] 10.222.0.93 () {60 vars in 1365 bytes} [Tue Jul 26 14:55:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 14:55:08.761335 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17028042-6db0-4187-b9a2-8f253f1a044e None None] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:08.761973 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17028042-6db0-4187-b9a2-8f253f1a044e None None] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:08.761973 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17028042-6db0-4187-b9a2-8f253f1a044e None None] PATH_INFO: `/` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:08.763995 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 730/1488] 10.222.0.93 () {54 vars in 926 bytes} [Tue Jul 26 14:55:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 14:55:08.770030 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40ee59c-56c7-4931-a8c5-1ef71e3cfc4f None None] REQUEST_METHOD: `POST` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:08.770517 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40ee59c-56c7-4931-a8c5-1ef71e3cfc4f None None] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:08.770612 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40ee59c-56c7-4931-a8c5-1ef71e3cfc4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:08.851823 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.auth.core [None req-d40ee59c-56c7-4931-a8c5-1ef71e3cfc4f None None] MFA Rules not processed for user `e5ef88cc058f425b882bcb87a1e1e75c`. Rule list: `[]` (Enabled: `True`). {{(pid=87056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:55:08.853057 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.fernet_utils [None req-d40ee59c-56c7-4931-a8c5-1ef71e3cfc4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:55:08.919848 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:55:08.971229 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 759/1489] 10.222.0.93 () {58 vars in 1023 bytes} [Tue Jul 26 14:55:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 14:55:09.015260 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17028042-6db0-4187-b9a2-8f253f1a044e None None] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:55:09.016838 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.fernet_utils [None req-17028042-6db0-4187-b9a2-8f253f1a044e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:55:09.071125 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:55:09.152064 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17028042-6db0-4187-b9a2-8f253f1a044e None None] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:55:09.243170 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bb567f-7667-4a46-91ab-faae3ff4bada service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '541dcf2b85a145e99c7d0663a0ac0918', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c422a2290a14424da20e2841cbc1741d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:55:09.243864 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bb567f-7667-4a46-91ab-faae3ff4bada service neutron] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:09.244248 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bb567f-7667-4a46-91ab-faae3ff4bada service neutron] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:09.244649 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bb567f-7667-4a46-91ab-faae3ff4bada service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:09.246693 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.fernet_utils [None req-24bb567f-7667-4a46-91ab-faae3ff4bada service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:55:09.355259 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:55:09.388733 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bb567f-7667-4a46-91ab-faae3ff4bada service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:55:09.390114 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bb567f-7667-4a46-91ab-faae3ff4bada service neutron] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:55:09.412849 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 731/1490] 10.222.0.93 () {60 vars in 1365 bytes} [Tue Jul 26 14:55:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 14:55:12.258901 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb6883e-8657-4082-944c-7e1ecde3f3bd None None] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:12.259766 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb6883e-8657-4082-944c-7e1ecde3f3bd None None] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:12.259996 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb6883e-8657-4082-944c-7e1ecde3f3bd None None] PATH_INFO: `/` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:12.261498 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 760/1491] 10.222.0.93 () {54 vars in 926 bytes} [Tue Jul 26 14:55:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 14:55:12.268398 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4527465f-3145-48e7-b69f-96da53ea5e8d None None] REQUEST_METHOD: `POST` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:12.269177 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4527465f-3145-48e7-b69f-96da53ea5e8d None None] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:12.269177 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4527465f-3145-48e7-b69f-96da53ea5e8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:12.348672 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.auth.core [None req-4527465f-3145-48e7-b69f-96da53ea5e8d None None] MFA Rules not processed for user `e5ef88cc058f425b882bcb87a1e1e75c`. Rule list: `[]` (Enabled: `True`). {{(pid=87055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:55:12.349901 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.fernet_utils [None req-4527465f-3145-48e7-b69f-96da53ea5e8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:55:12.477946 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 732/1492] 10.222.0.93 () {58 vars in 1023 bytes} [Tue Jul 26 14:55:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 14:55:12.535895 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb6883e-8657-4082-944c-7e1ecde3f3bd None None] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:55:12.537948 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.fernet_utils [None req-dbb6883e-8657-4082-944c-7e1ecde3f3bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:55:12.673974 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb6883e-8657-4082-944c-7e1ecde3f3bd None None] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:55:12.766582 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7952d14-c27b-43f2-b7d9-b5757f100bfe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '541dcf2b85a145e99c7d0663a0ac0918', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c422a2290a14424da20e2841cbc1741d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:55:12.768089 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7952d14-c27b-43f2-b7d9-b5757f100bfe service neutron] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:55:12.768089 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7952d14-c27b-43f2-b7d9-b5757f100bfe service neutron] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:55:12.768403 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7952d14-c27b-43f2-b7d9-b5757f100bfe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:55:12.770329 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.fernet_utils [None req-e7952d14-c27b-43f2-b7d9-b5757f100bfe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:55:12.782577 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=100 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:55:12.899628 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7952d14-c27b-43f2-b7d9-b5757f100bfe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:55:12.901175 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7952d14-c27b-43f2-b7d9-b5757f100bfe service neutron] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:55:12.924102 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 761/1493] 10.222.0.93 () {60 vars in 1365 bytes} [Tue Jul 26 14:55:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 14:55:22.475824 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=82 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:55:22.921361 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=50 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:57:06.842349 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acc23c8-62a4-490f-aa8f-c339bdaba870 None None] REQUEST_METHOD: `POST` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:57:06.843068 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acc23c8-62a4-490f-aa8f-c339bdaba870 None None] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:57:06.843205 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acc23c8-62a4-490f-aa8f-c339bdaba870 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:57:06.951906 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.auth.core [None req-1acc23c8-62a4-490f-aa8f-c339bdaba870 None None] MFA Rules not processed for user `e5ef88cc058f425b882bcb87a1e1e75c`. Rule list: `[]` (Enabled: `True`). {{(pid=87055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:57:06.953291 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.fernet_utils [None req-1acc23c8-62a4-490f-aa8f-c339bdaba870 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:57:07.111895 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 733/1494] 10.222.0.93 () {58 vars in 958 bytes} [Tue Jul 26 14:57:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 14:57:07.121702 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb09898-2b58-4531-8bf0-76c5f6d8ee99 None None] REQUEST_METHOD: `POST` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:57:07.122398 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb09898-2b58-4531-8bf0-76c5f6d8ee99 None None] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:57:07.122754 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb09898-2b58-4531-8bf0-76c5f6d8ee99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:57:07.157355 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.auth.core [None req-ddb09898-2b58-4531-8bf0-76c5f6d8ee99 None None] MFA Rules not processed for user `e5ef88cc058f425b882bcb87a1e1e75c`. Rule list: `[]` (Enabled: `True`). {{(pid=87056) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:57:07.159506 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.fernet_utils [None req-ddb09898-2b58-4531-8bf0-76c5f6d8ee99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:57:07.171340 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 762/1495] 10.222.0.93 () {58 vars in 958 bytes} [Tue Jul 26 14:57:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 14:57:07.177241 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acc23c8-62a4-490f-aa8f-c339bdaba870 None None] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:57:07.191817 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acc23c8-62a4-490f-aa8f-c339bdaba870 None None] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:57:07.197769 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849aa0b2-0d89-456b-b308-9dd303173732 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f499667f2a194620a3504e461bf3cc25', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:57:07.198443 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849aa0b2-0d89-456b-b308-9dd303173732 admin admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:57:07.198762 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849aa0b2-0d89-456b-b308-9dd303173732 admin admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:57:07.199037 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849aa0b2-0d89-456b-b308-9dd303173732 admin admin] PATH_INFO: `/v3/domains` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:57:07.199748 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849aa0b2-0d89-456b-b308-9dd303173732 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 14:57:07.200053 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849aa0b2-0d89-456b-b308-9dd303173732 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:57:07.201154 dv-cinder-851030-1-smb devstack@keystone.service[87055]: WARNING py.warnings [None req-849aa0b2-0d89-456b-b308-9dd303173732 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:57:07.201154 dv-cinder-851030-1-smb devstack@keystone.service[87055]: warnings.warn(msg) Jul 26 14:57:07.201154 dv-cinder-851030-1-smb devstack@keystone.service[87055]: Jul 26 14:57:07.202057 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849aa0b2-0d89-456b-b308-9dd303173732 admin admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:57:07.216862 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 734/1496] 10.222.0.93 () {58 vars in 1153 bytes} [Tue Jul 26 14:57:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 14:57:07.225698 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb09898-2b58-4531-8bf0-76c5f6d8ee99 None None] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:57:07.235583 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb09898-2b58-4531-8bf0-76c5f6d8ee99 None None] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:57:07.240321 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec65303-85d8-4e35-bb36-8732100c8d41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f499667f2a194620a3504e461bf3cc25', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:57:07.240953 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec65303-85d8-4e35-bb36-8732100c8d41 admin admin] REQUEST_METHOD: `POST` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:57:07.241240 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec65303-85d8-4e35-bb36-8732100c8d41 admin admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:57:07.241515 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec65303-85d8-4e35-bb36-8732100c8d41 admin admin] PATH_INFO: `/v3/projects` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:57:07.242181 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec65303-85d8-4e35-bb36-8732100c8d41 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:57:07.244074 dv-cinder-851030-1-smb devstack@keystone.service[87056]: WARNING py.warnings [None req-2ec65303-85d8-4e35-bb36-8732100c8d41 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:57:07.244074 dv-cinder-851030-1-smb devstack@keystone.service[87056]: warnings.warn(msg) Jul 26 14:57:07.244074 dv-cinder-851030-1-smb devstack@keystone.service[87056]: Jul 26 14:57:07.245294 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec65303-85d8-4e35-bb36-8732100c8d41 admin admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:57:07.403714 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 763/1497] 10.222.0.93 () {60 vars in 1153 bytes} [Tue Jul 26 14:57:07 2022] POST /identity/v3/projects => generated 377 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 14:57:07.406060 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849aa0b2-0d89-456b-b308-9dd303173732 admin admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:57:07.418050 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849aa0b2-0d89-456b-b308-9dd303173732 admin admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:57:07.478416 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=100 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:57:07.487373 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af8f73d-ce0a-498b-83c5-d20ce5c1b0ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f499667f2a194620a3504e461bf3cc25', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:57:07.488363 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af8f73d-ce0a-498b-83c5-d20ce5c1b0ef admin admin] REQUEST_METHOD: `POST` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:57:07.488759 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af8f73d-ce0a-498b-83c5-d20ce5c1b0ef admin admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:57:07.489258 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af8f73d-ce0a-498b-83c5-d20ce5c1b0ef admin admin] PATH_INFO: `/v3/users` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:57:07.490272 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af8f73d-ce0a-498b-83c5-d20ce5c1b0ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:57:07.491799 dv-cinder-851030-1-smb devstack@keystone.service[87055]: WARNING py.warnings [None req-7af8f73d-ce0a-498b-83c5-d20ce5c1b0ef admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:57:07.491799 dv-cinder-851030-1-smb devstack@keystone.service[87055]: warnings.warn(msg) Jul 26 14:57:07.491799 dv-cinder-851030-1-smb devstack@keystone.service[87055]: Jul 26 14:57:07.493763 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af8f73d-ce0a-498b-83c5-d20ce5c1b0ef admin admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:57:07.657281 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 735/1498] 10.222.0.93 () {60 vars in 1144 bytes} [Tue Jul 26 14:57:07 2022] POST /identity/v3/users => generated 289 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 14:57:07.662338 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec65303-85d8-4e35-bb36-8732100c8d41 admin admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:57:07.674270 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec65303-85d8-4e35-bb36-8732100c8d41 admin admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:57:07.679278 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f15c77d-06a3-492c-af44-88694efebcdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f499667f2a194620a3504e461bf3cc25', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:57:07.680012 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f15c77d-06a3-492c-af44-88694efebcdb admin admin] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:57:07.680313 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f15c77d-06a3-492c-af44-88694efebcdb admin admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:57:07.680589 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f15c77d-06a3-492c-af44-88694efebcdb admin admin] PATH_INFO: `/v3/roles` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:57:07.681321 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f15c77d-06a3-492c-af44-88694efebcdb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:57:07.682454 dv-cinder-851030-1-smb devstack@keystone.service[87056]: WARNING py.warnings [None req-3f15c77d-06a3-492c-af44-88694efebcdb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:57:07.682454 dv-cinder-851030-1-smb devstack@keystone.service[87056]: warnings.warn(msg) Jul 26 14:57:07.682454 dv-cinder-851030-1-smb devstack@keystone.service[87056]: Jul 26 14:57:07.683378 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f15c77d-06a3-492c-af44-88694efebcdb admin admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:57:07.697964 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 764/1499] 10.222.0.93 () {58 vars in 1122 bytes} [Tue Jul 26 14:57:07 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 14:57:07.703859 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af8f73d-ce0a-498b-83c5-d20ce5c1b0ef admin admin] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:57:07.717031 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af8f73d-ce0a-498b-83c5-d20ce5c1b0ef admin admin] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:57:07.723800 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01787188-3e39-45ed-be0c-341261036d21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f499667f2a194620a3504e461bf3cc25', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:57:07.731243 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01787188-3e39-45ed-be0c-341261036d21 admin admin] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:57:07.731243 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01787188-3e39-45ed-be0c-341261036d21 admin admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:57:07.731243 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01787188-3e39-45ed-be0c-341261036d21 admin admin] PATH_INFO: `/v3/roles` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:57:07.731243 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01787188-3e39-45ed-be0c-341261036d21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:57:07.731243 dv-cinder-851030-1-smb devstack@keystone.service[87055]: WARNING py.warnings [None req-01787188-3e39-45ed-be0c-341261036d21 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:57:07.731243 dv-cinder-851030-1-smb devstack@keystone.service[87055]: warnings.warn(msg) Jul 26 14:57:07.731243 dv-cinder-851030-1-smb devstack@keystone.service[87055]: Jul 26 14:57:07.732304 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01787188-3e39-45ed-be0c-341261036d21 admin admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:57:07.745386 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 736/1500] 10.222.0.93 () {58 vars in 1122 bytes} [Tue Jul 26 14:57:07 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 14:57:07.750280 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f15c77d-06a3-492c-af44-88694efebcdb admin admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:57:07.761900 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f15c77d-06a3-492c-af44-88694efebcdb admin admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:57:07.767201 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c3b841-95d7-41b7-9dd2-5587a943b5a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f499667f2a194620a3504e461bf3cc25', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:57:07.768011 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c3b841-95d7-41b7-9dd2-5587a943b5a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:57:07.768404 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c3b841-95d7-41b7-9dd2-5587a943b5a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:57:07.768782 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c3b841-95d7-41b7-9dd2-5587a943b5a1 admin admin] PATH_INFO: `/v3/projects/e96273392cd04a9dbf55a1b1f1e35953/users/97e29c707e744d199d7546eaf48ea9c5/roles/8b8a4a451dc84c17bba824b2ff9cc4fe` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:57:07.789492 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c3b841-95d7-41b7-9dd2-5587a943b5a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e96273392cd04a9dbf55a1b1f1e35953, user_id=97e29c707e744d199d7546eaf48ea9c5, role_id=8b8a4a451dc84c17bba824b2ff9cc4fe)` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:57:07.791417 dv-cinder-851030-1-smb devstack@keystone.service[87056]: WARNING py.warnings [None req-62c3b841-95d7-41b7-9dd2-5587a943b5a1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:57:07.791417 dv-cinder-851030-1-smb devstack@keystone.service[87056]: warnings.warn(msg) Jul 26 14:57:07.791417 dv-cinder-851030-1-smb devstack@keystone.service[87056]: Jul 26 14:57:07.793444 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c3b841-95d7-41b7-9dd2-5587a943b5a1 admin admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:57:07.890418 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 765/1501] 10.222.0.93 () {60 vars in 1483 bytes} [Tue Jul 26 14:57:07 2022] PUT /identity/v3/projects/e96273392cd04a9dbf55a1b1f1e35953/users/97e29c707e744d199d7546eaf48ea9c5/roles/8b8a4a451dc84c17bba824b2ff9cc4fe => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 14:57:07.904493 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7fa8be-2449-4e5a-b55d-a4f251a5d6c8 None None] REQUEST_METHOD: `POST` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:57:07.914978 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7fa8be-2449-4e5a-b55d-a4f251a5d6c8 None None] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:57:07.914978 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7fa8be-2449-4e5a-b55d-a4f251a5d6c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:57:07.938731 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.auth.core [None req-2c7fa8be-2449-4e5a-b55d-a4f251a5d6c8 None None] MFA Rules not processed for user `97e29c707e744d199d7546eaf48ea9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=87055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:57:07.940041 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.fernet_utils [None req-2c7fa8be-2449-4e5a-b55d-a4f251a5d6c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:57:08.019020 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 737/1502] 10.222.0.93 () {58 vars in 958 bytes} [Tue Jul 26 14:57:07 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 14:57:08.034959 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633c3d6c-50ef-4588-9c81-3552d9a7636d None None] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:57:08.035385 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633c3d6c-50ef-4588-9c81-3552d9a7636d None None] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:57:08.035763 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633c3d6c-50ef-4588-9c81-3552d9a7636d None None] PATH_INFO: `/` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:57:08.037325 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 766/1503] 10.222.0.93 () {54 vars in 964 bytes} [Tue Jul 26 14:57:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 14:57:08.043525 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af03fd2-5355-48c9-9616-224987a4ccbe None None] REQUEST_METHOD: `POST` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:57:08.043990 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af03fd2-5355-48c9-9616-224987a4ccbe None None] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:57:08.044376 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af03fd2-5355-48c9-9616-224987a4ccbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:57:08.117860 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.auth.core [None req-8af03fd2-5355-48c9-9616-224987a4ccbe None None] MFA Rules not processed for user `6780136eb21e4c8da1950b126284639e`. Rule list: `[]` (Enabled: `True`). {{(pid=87055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:57:08.119332 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.fernet_utils [None req-8af03fd2-5355-48c9-9616-224987a4ccbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:57:08.222822 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 738/1504] 10.222.0.93 () {58 vars in 1061 bytes} [Tue Jul 26 14:57:08 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 14:57:08.232289 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633c3d6c-50ef-4588-9c81-3552d9a7636d None None] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:57:08.244901 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633c3d6c-50ef-4588-9c81-3552d9a7636d None None] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:57:08.248905 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccab48a-7cec-4954-a28a-d664a9ba1969 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6780136eb21e4c8da1950b126284639e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c422a2290a14424da20e2841cbc1741d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:57:08.249608 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccab48a-7cec-4954-a28a-d664a9ba1969 service cinder] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:57:08.249930 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccab48a-7cec-4954-a28a-d664a9ba1969 service cinder] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:57:08.250289 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccab48a-7cec-4954-a28a-d664a9ba1969 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:57:08.261759 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccab48a-7cec-4954-a28a-d664a9ba1969 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:57:08.263587 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccab48a-7cec-4954-a28a-d664a9ba1969 service cinder] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:57:08.275569 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 767/1505] 10.222.0.93 () {60 vars in 1365 bytes} [Tue Jul 26 14:57:08 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 14:57:08.328063 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007de004-fa94-498e-abc5-2fde55bebdb4 None None] REQUEST_METHOD: `GET` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:57:08.328353 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007de004-fa94-498e-abc5-2fde55bebdb4 None None] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:57:08.328632 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007de004-fa94-498e-abc5-2fde55bebdb4 None None] PATH_INFO: `/` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:57:08.329946 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 739/1506] 10.222.0.93 () {52 vars in 830 bytes} [Tue Jul 26 14:57:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 14:57:08.334526 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccab48a-7cec-4954-a28a-d664a9ba1969 service cinder] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:57:08.410924 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccab48a-7cec-4954-a28a-d664a9ba1969 service cinder] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:57:08.417702 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099c341c-b5ff-4e91-a63f-2b1f5f593b0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f499667f2a194620a3504e461bf3cc25', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:57:08.419278 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099c341c-b5ff-4e91-a63f-2b1f5f593b0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:57:08.419855 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099c341c-b5ff-4e91-a63f-2b1f5f593b0b admin admin] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:57:08.420281 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099c341c-b5ff-4e91-a63f-2b1f5f593b0b admin admin] PATH_INFO: `/v3/users/97e29c707e744d199d7546eaf48ea9c5` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:57:08.422385 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099c341c-b5ff-4e91-a63f-2b1f5f593b0b admin admin] RBAC: Authorizing `identity:delete_user(user_id=97e29c707e744d199d7546eaf48ea9c5)` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:57:08.423828 dv-cinder-851030-1-smb devstack@keystone.service[87056]: WARNING py.warnings [None req-099c341c-b5ff-4e91-a63f-2b1f5f593b0b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:57:08.423828 dv-cinder-851030-1-smb devstack@keystone.service[87056]: warnings.warn(msg) Jul 26 14:57:08.423828 dv-cinder-851030-1-smb devstack@keystone.service[87056]: Jul 26 14:57:08.425091 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099c341c-b5ff-4e91-a63f-2b1f5f593b0b admin admin] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:57:08.746444 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.notifications [None req-099c341c-b5ff-4e91-a63f-2b1f5f593b0b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '97e29c707e744d199d7546eaf48ea9c5'} {{(pid=87056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 14:57:08.750905 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.notifications [None req-099c341c-b5ff-4e91-a63f-2b1f5f593b0b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '97e29c707e744d199d7546eaf48ea9c5'} {{(pid=87056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 14:57:08.750905 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.notifications [None req-099c341c-b5ff-4e91-a63f-2b1f5f593b0b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '97e29c707e744d199d7546eaf48ea9c5'} {{(pid=87056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 14:57:08.770414 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.notifications [None req-099c341c-b5ff-4e91-a63f-2b1f5f593b0b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '97e29c707e744d199d7546eaf48ea9c5'} {{(pid=87056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 14:57:08.888522 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.notifications [None req-099c341c-b5ff-4e91-a63f-2b1f5f593b0b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '97e29c707e744d199d7546eaf48ea9c5'} {{(pid=87056) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 14:57:08.900577 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:57:08.912453 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 768/1507] 10.222.0.93 () {58 vars in 1224 bytes} [Tue Jul 26 14:57:08 2022] DELETE /identity/v3/users/97e29c707e744d199d7546eaf48ea9c5 => generated 0 bytes in 579 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 14:57:08.917803 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845caf61-216b-488c-87f7-f37f3f15ace0 None None] REQUEST_METHOD: `POST` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:57:08.918421 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845caf61-216b-488c-87f7-f37f3f15ace0 None None] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:57:08.918520 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845caf61-216b-488c-87f7-f37f3f15ace0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:57:08.939192 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.auth.core [None req-845caf61-216b-488c-87f7-f37f3f15ace0 None None] MFA Rules not processed for user `e5ef88cc058f425b882bcb87a1e1e75c`. Rule list: `[]` (Enabled: `True`). {{(pid=87055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 14:57:08.940431 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.fernet_utils [None req-845caf61-216b-488c-87f7-f37f3f15ace0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:57:08.952353 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:57:09.021116 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 740/1508] 10.222.0.93 () {58 vars in 958 bytes} [Tue Jul 26 14:57:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 14:57:09.031971 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099c341c-b5ff-4e91-a63f-2b1f5f593b0b admin admin] Authenticating user token {{(pid=87056) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:57:09.033438 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.fernet_utils [None req-099c341c-b5ff-4e91-a63f-2b1f5f593b0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87056) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:57:09.127003 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099c341c-b5ff-4e91-a63f-2b1f5f593b0b admin admin] Validating token access rules against request {{(pid=87056) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:57:09.130978 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa61b57-00c8-46d9-a919-0364e830f6e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '541dcf2b85a145e99c7d0663a0ac0918', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c422a2290a14424da20e2841cbc1741d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87056) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:57:09.131634 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa61b57-00c8-46d9-a919-0364e830f6e4 service neutron] REQUEST_METHOD: `GET` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:57:09.131921 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa61b57-00c8-46d9-a919-0364e830f6e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:57:09.132200 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa61b57-00c8-46d9-a919-0364e830f6e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87056) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:57:09.142489 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa61b57-00c8-46d9-a919-0364e830f6e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:57:09.144228 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa61b57-00c8-46d9-a919-0364e830f6e4 service neutron] RBAC: Authorization granted {{(pid=87056) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:57:09.157499 dv-cinder-851030-1-smb devstack@keystone.service[87056]: [pid: 87056|app: 0|req: 769/1509] 10.222.0.93 () {60 vars in 1365 bytes} [Tue Jul 26 14:57:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 14:57:09.833655 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845caf61-216b-488c-87f7-f37f3f15ace0 None None] Authenticating user token {{(pid=87055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 14:57:09.835484 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.fernet_utils [None req-845caf61-216b-488c-87f7-f37f3f15ace0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 14:57:09.851035 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845caf61-216b-488c-87f7-f37f3f15ace0 None None] Validating token access rules against request {{(pid=87055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 14:57:09.858531 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca36089e-7edb-4cf7-85b4-83b9e3101be6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5ef88cc058f425b882bcb87a1e1e75c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f499667f2a194620a3504e461bf3cc25', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 14:57:09.860542 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca36089e-7edb-4cf7-85b4-83b9e3101be6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 14:57:09.860542 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca36089e-7edb-4cf7-85b4-83b9e3101be6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 14:57:09.860542 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca36089e-7edb-4cf7-85b4-83b9e3101be6 admin admin] PATH_INFO: `/v3/projects/e96273392cd04a9dbf55a1b1f1e35953` {{(pid=87055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 14:57:09.863024 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca36089e-7edb-4cf7-85b4-83b9e3101be6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e96273392cd04a9dbf55a1b1f1e35953)` {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 14:57:09.864623 dv-cinder-851030-1-smb devstack@keystone.service[87055]: WARNING py.warnings [None req-ca36089e-7edb-4cf7-85b4-83b9e3101be6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:57:09.864623 dv-cinder-851030-1-smb devstack@keystone.service[87055]: warnings.warn(msg) Jul 26 14:57:09.864623 dv-cinder-851030-1-smb devstack@keystone.service[87055]: Jul 26 14:57:09.866092 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca36089e-7edb-4cf7-85b4-83b9e3101be6 admin admin] RBAC: Authorization granted {{(pid=87055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 14:57:10.040513 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.notifications [None req-ca36089e-7edb-4cf7-85b4-83b9e3101be6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e96273392cd04a9dbf55a1b1f1e35953', 'request_id': 'req-ca36089e-7edb-4cf7-85b4-83b9e3101be6'} {{(pid=87055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 14:57:10.465890 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.notifications [None req-ca36089e-7edb-4cf7-85b4-83b9e3101be6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e96273392cd04a9dbf55a1b1f1e35953', 'request_id': 'req-ca36089e-7edb-4cf7-85b4-83b9e3101be6'} {{(pid=87055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 14:57:10.473418 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.notifications [None req-ca36089e-7edb-4cf7-85b4-83b9e3101be6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e96273392cd04a9dbf55a1b1f1e35953', 'request_id': 'req-ca36089e-7edb-4cf7-85b4-83b9e3101be6'} {{(pid=87055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 14:57:10.503995 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.notifications [None req-ca36089e-7edb-4cf7-85b4-83b9e3101be6 admin admin] The token cache is being invalidate because project e96273392cd04a9dbf55a1b1f1e35953 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87055) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 14:57:10.504290 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.notifications [None req-ca36089e-7edb-4cf7-85b4-83b9e3101be6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 14:57:10.504981 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG keystone.notifications [None req-ca36089e-7edb-4cf7-85b4-83b9e3101be6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 14:57:10.506956 dv-cinder-851030-1-smb devstack@keystone.service[87055]: [pid: 87055|app: 0|req: 741/1510] 10.222.0.93 () {58 vars in 1233 bytes} [Tue Jul 26 14:57:09 2022] DELETE /identity/v3/projects/e96273392cd04a9dbf55a1b1f1e35953 => generated 0 bytes in 674 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 14:57:19.220252 dv-cinder-851030-1-smb devstack@keystone.service[87056]: DEBUG dbcounter [-] [87056] Writing DB stats keystone:SELECT=38 {{(pid=87056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:57:20.500546 dv-cinder-851030-1-smb devstack@keystone.service[87055]: DEBUG dbcounter [-] [87055] Writing DB stats keystone:SELECT=47,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}